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APgTRACa* 

A  otudy  was  parfoi*med  to  detornlne  the  roqulrcments 
for  anvl  the  oiotnontB  of  a  human  i)ei‘formanco  reliability 
(HPR)  data  By8tum4  The  heart  of  the  IIPR  eystem  Is  a 
taxonomic  atructure  for  claoeifylng  behavioral  studiaa. 
lUO  Dtudlea  from  a  vorioty  of  aoupcao  ware  coded  using 
this  tnxonomy*  To  toet  the  efficiency  of  this  data 
brink  to  provide  anuvmrn  to  ayotera  development  queatlons 
a  number  of  testa  wore  per formed  to  determine  tho  rele¬ 
vance  of  tho  data  retrieved  to  the  quoatlona  asked. 

Ttia  results  of  thena  teats  indicated  that  It  Is  jkdsbI- 
blo  to  expand  the  HPH  data  base  provided  one  io  not 
rnutriotod  to  a  prohubilloHo  metric. 

JNTRODUgriOH 

The  primary  purpose  of  this  ntudy  was  to  determine 
the  fouQlbillty  of  expanding  tho  amount  of  data  avail¬ 
able  for  predicting  mon-machlno  pc?rforttiancu  and  to  de¬ 
velop  n  irwthodoloo’  for  performing  that  expansion. 

ThlB  study  lo  puru  of  a  larger  program  to  develop  an 
HPR  oyatem. 

We  have  uQcd  the  term  "human  performance  reliability" 
or  HPR  to  denote  a  metric  for  the  prediction  of  man- 
niachlno  performance.  In  general^  that  prediction  re¬ 
fers  to  the  anticipation  of  any  type  of  performance  ef¬ 
fect  resulting  from  the  combination  of  men  and  machines. 
One  way  of  conceptualizing  man-machine  prediction  le 
ao  the  application  of  performance  data  in  order  to  hu¬ 
man  engineer  design.  In  the  more  traditional  and  re- 
strlotud  rollabllity  sonao;  tmm-machina  prediction  is 
tho  application  of  probabilistic  data  to  oan-machlno 
relationships  to  ootablish  a  (luantltatlve  figujo  of 
mnrit,  o.g.j  997dj  for  those  rolatlonehipB.  Wc  also 
distinguish  between  tho  HPR  data  system  a^id  the  data 
bank  which  Is  on(j  element  of  that  system.  Tlic  term 
HPR  refers  to  the  system^  not  to  the  data  bank. 

Obviously;  HPR  predlotlon  is  only  ao  effective  as 
the  body  of  quantitative  data  on  the  basis  of  which  one 
predietD.  Hence  the  necessity  for  a  substantial  data 
bank.  The  inadequacies  of  presently  available  HPR  data 
banks  have  beon  pointed  out  rupentedly  by  workers  In 
tho  HPR  fl  }-  Melster,  196^;  Swain,  1964;  and 

Altman,  Ittempts  have  been  made  to  romedy  the 

deflclencit-  such  efforts  as  the  American  Institute 
for  Research  (AIR)  Data  Store  (Hunger  et  al,  196^}  and 
by  compilations  made  by  Blanchard  et  al.  (1966);  Irwin 
et  al.  (1964)  and  Homyak  (1967),  but  all  of  those  with 
Indifferent  bucccob. 

An  adequate  data  bank  must  be  both  compruhenslvo 
(l.e»;  based  on  a  sufficiently  It^cge  number  of  studies) 
and  relevant  to  syelom  development  goals.  One  oiight 
assume  that  in  view  of  the  thousands  of  behavioral 
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uourcf-'u  in  th';  Jiiorature  there  would  be  no  difficulty 
in  ostabl  Inhinf;  a  comprehensive  data  bank.  However, 
preocni.  data  bonko  ore  not  comprehenulvo,  the  AIR  Data 
Store  (tho  one  moot  generally  used)  being  based  on  only 
l64  studies. 

Ono  roaaon  for  present  data  bonk  deficiencies  is  that 
there  is  a  dlfforonco  botwonn  the  availability  of  data 
uourcoo  und  tho  availability  of  data  for  use  in  an  HPR 
data  bank.  Dcuplie  the  large  number  of  behavioral  data 
nourcun,  tho  data  they  contain  are  not  necessarily  rele¬ 
vant  to  the  Eipoeialized  ruquireau^ntu  of  HPR.  Because  of 
thla  we  distinguish  bntwcon  tho  general  behavioral  llt- 
oratJire,  which  be  more  or  loss  reluvant,  and  what  we 
cul]  inun-inuehlne-opoclflc  literature,  vtilch  ono  would 
aosutoii  to  be  highly  relevant. 

Man-machine  relevance  lu  directly  related  to  the  de¬ 
gree  of  nimllarity  between  the  task  characteristics 
found  in  potential  data  aourceo  (the  studies)  vid  the 
charactorlatlcD  of  the  tnokn  employed  In  operational 
oyuteniu.  By  tauk  characteristics  we  refer  tos  the  be- 
havlorol  functions  of  the  task,  the  nature  of  the  atimu- 
11  and  t\iQ  rcDi'onDo  equipment,  the  nature  of  the  Indivi¬ 
duals  performing  tho  tasks  and  the  physical  and  task  en¬ 
vironment  in  which  they  purfom.  'Ilie  more  each  of  these 
raoomblo  those  found  in  operational  ayEtonuj,  the  greatar 
the  relevance  of  the  study. 

Becaune  each  of  those  task  characteristics  must  be 
conoldcrcd;  It  lo  not  enough  for  the  subject  matter  of 
tho  Dtudy  to  appoor  relevant,  for  even  In  this  case  the 
data  within  tho  study  may  nut  be  coBg>letely  relevant} 
and  even  if  the  data  are  ralovant,  they  may  not  be  in  a 
form  which  nakos  them  readily  usable  for  HPR  purposes. 

The  task  of  data  bank  development  is  therefore  not  as 
simple  as  It  might  appear  on  the  surface.  I^ter  we 
shall  dlscuofj  in  detail  the  special  roquirements  of  HPH 
and  th''  impllcatlonu  these  have  for  the  development  of 
an  appropriate  data  bank.  For  the  moment  it  is  enough 
to  say  tliat  HPR  has  two  general  requirements:  to  predict 
the  performance  of  personnel  performing  In  a  man-mschlna 
context}  find  to  help  in  the  solution  of  design  probletos 
In  a  manner  that  will  maximize  that  personnel  perform¬ 
ance. 

Dodpite  the  problems  that  have  been  cited,  It  seems 
reasonable  to  assume  that  a  large  oacunt  of  data  exists 
In  the  general  behavioral  literature  that  might  be  used 
to  oxp'uid  available  HPR  data  banks.  It  therefore  aakes 
senso  to  try  to  extract  those  data  from  the  literature 
and  to  put  them  Into  a  form  usable  for  HPR  prediction. 

The  study  hod  three  phases.  In  the  first  phase  an 
examination  van  made  of  the  kinds  of  syatea  development 
quest  ions  which  on  HPR  data  system  should  be  capable  of 
answering.  There  would  be  very  little  point  in  develop¬ 
ing  a  system  which  had  only  theoreticsl  use  by  research¬ 
ers.  The  first  phase  also  required  the  development  of  a 
methodology  which  would  permit  the  expansion  of  the  HPR 
data  base.  This  methodology  was  conceptualized  in  terok 
of  u  schomo  for  classifying  the  behavioral  research  in 
HPR  terms  (l.e.,  a  taxonony).  Phase  I  concluded  with 
tho  development  of  a  detailed  specification  for  an  HPR 
data  ayutem  (what  it  chould  consist  of). 

The  necond  phase  Involved  the  application  of  the. 
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taxcniotf\y  tiO  atuiUnh  oxtruole-l  fi’cm  the  1  Itcr^turi)  to 
form  H  pri.‘l Imtnary  IfPR  'lata  h»Liik.  Thin  ttuta  hoak  wiib  to 
be  pui'riy  liii.  tv  n:’.  n.  vf 

Iht*  fi'ftn lb LJ  1  t.y  of  t.lv'  nustho'loiu^.  'Hio  do« 

Vt.  lofiineiit  'inil  vul  tiiaM  1.111  ol’  u  i‘ampi*i'h-.‘r\n  Lvo  IIVH  ‘UiLu  bonk 
yr'rc  maiUl. fitly  beyond  the  e.-upi*  of  a  iilngie  otuciy. 

Tn  phan-j  HI  tbo  pro]  Imlnary  KPR  data  bank  wua  >ip- 
plliKl  to  the  nolut.Lori  uf  u  riamber  of  nyut.«ftt  »lev«*loj>ini»nt 
problomn  or  ciuect  iunii  uu^p.otitod  by  hji  artaal  ayotem  »le- 
V*'»Jopnii'nt  projei-t  ,  The  nuccoae  of  thlu  tout  vouid  Indl- 
rat.ft  huw  promlalng  thu  iTropoiied  mothudolo^^  wjifl. 

HUrHOD 

Nftt  tu’o  of  tho  Vrob  lotn 

To  miiko  uae  of  tho  data  in  the  Koncral  behuvioral 
Ittfiralarn,  It.  In  necounai7  to  intograto  data  derived 
rrorn  a  variety  of  rtudleo,  each  of  vtilch  used  different 
twl.hodn,  different  <''idlpmento  und  Investigated  tllfferent 
variables  > 

The  data,  whethor  oypreuQiid  i.n  the  form  of  error 
or  t.tmo  or  any  other  meufluro,  pose  relatively  iit« 
lie  prohlrjia  for  tho  dijvuiopor  of  the  HTR  data  uynlom* 

The  difficulty  tlio  latter  encuvmtera  Iloa  In  tho  fact 
that  tho  nbudy  eiemento  In  the  general  literature  either 
do  not  (loncrlbe  man-macliine  operations,  or  do  oo  on.ly  In 
part.  If  ^hc  tank  ulemnnto  Iri  bho  general  IttomtuTu 
aduquatoly  doner Ibod  thnoo  riian-'machino  op<‘rRtiona,  their 
data  euuld  bo  uood  fairly  readily. 

Tho  pi'obl(Mn,  thoreforci  bocoiuou  one  of  clasollVlng 
the  olomont.n  of  tehuviorul  ctudlca  in  terms  ouch  that 
they  agree  b1fh  tho  oloinont'3  dooorlblng  man  -  mac  h  In*;  re- 
latlonshlpo.  If  bohavloral  task  eleinout  X  lu  defined  an 
e^iUvalent  to  man-macUlno  touk  olenent  data  deucrlbo 
Ing  the  former  con  bu  combined  with  data  describing  the 
latter. 

It  lu  ruasonublo  to  aanuoio  that  general  behavioral 
and  (nan>iiiachlno  urjKu  aro  rc.latod  at  soiae  higher  order 
level.  Obvlouuly  the  performance,  of  a  tnan-machlnQ  task 
Involves  oomo  bahavLorul  foundation.  r*or  example,  to 
road  a  meter  Involvou  porceptia^,  no  matter  what  ulee  it 
Invo.lvoo*  When  a  subject  in  a  psychological  atufy  rcado 
cards  an  hie  cxporimtintal  task,  ti  is  too  Inyolvee  per* 
coption.  The  problem  lo,  how  con  ve  equate  reading 
cards  with  reading  a  metor  (or  roading  any  disploy,  for 
that  matter)?  Tho  otlmuluo  characteristics  differ  in 
the  two  cuneb  and  it  lu  robuonublu  to  asuume  that  these 
ohoractorlnilcB  also  affect  the  manner  In  which  the 
function  (reading)  is  performed*  Nevertheleos,  if  one 
could  in  uoitv.'  faDhion  equate  the  two  funcUone,  the  data 
In  tho  behavioral  activity  could  be  used  to  predict  iUo 
performance  of  the  man-machine  activity. 

The  Problem  of  Claoolf icatlon 

Before  wu  can  equate  or  otht-rvlse  relate  two  or  more 
phenomena,  however,  they  must  be  c.laeslfled*  The  need 
for  a  oLar.ulflcatlon  system-  u  human  performance  taxono¬ 
my-  has  been  recognized  for  years  (see,  for  exan^ic, 
Melton  and  Briggu,  i960).  A  number  of  taxonomies  havo 
be*;n  developed  for  varying  purposes.  Claealf Ication 
temp  liavo  been  propooed  In  iertos  of  (l)  the  behaviors 
capable  of  being  observed  during  task  porformunco;  (2) 
th'-  behaviors,  functions  ur  procesoeo  presumably  re¬ 
quired  during  that  task  purfoi-mnnce,  but  which  munt  be 
inf*.‘rred  from  porformonce;  (3)  the  abllitiuc  tho  opera¬ 
tor  must  posaene  in  ordor  \.o  Gccomplioh  tasks;  (4)  the 
cluiractorlntico  of  tho  1  auk  in  toms  of  its  stlmuliio  and 
rosponso  proport  Ins  (eg.,  complexity,  sequence,  etc.). 

At  the  preoont  time  a  major  5-yoar  effort  is  being  un’* 
dt.rtuken  by  Flulshmoii  and  bln  co-woi’kera  (sei*  Chambers, 
1969)  under  ARPA  sponsorship  to  develop  a  human  pcrfo^Tn- 
anre  t/ixunoinic  system. 

TaxonoitUoD  dltfer,  however.  In  accordance  with  the 
purpose  for  which  the  taxonony  la  deelgned*  Previous 


workorr.  have  talked  of  the  taxonomic  problem  aa  If 
there  were  only  one  taxonomy,  und  'f  that  one  were  de- 
v.«ln^'wa<r  Jt.  wniild  itnlve  all  difficulties.  Hiia  Is  not 
true.  There  arc  oimply  a  number  of  possible  taxonomies 
for  illffi;roni  pai’posca  loading  to  different  conae- 
(pioiueti  and  Outputs.  Since  t,ha  HTR  eiasoif leatloo 
utn.cturc  J-**  dU*ccUfd  at  Uw,  ii^Logratloa  of  data  from 
widely  (lifforant  aourceu,  It  will  probably  differ 
materially  from  other  clfUiSiflcatlon  uystemo. 

Definition  of  bho  HPR  Data  System 

Although  this  study  was  directed  primarily  to  tho 
dovelopmenb  of  a  method  for  oxp^inding  the  HPR  data  bulw 
ouch  data  bank  cun  be  thought  of  ni’anlngfully  only 
iiu  put-L  of  un  overall  data  system*  It  is  therefore 
necosnary  to  wpoolfy  whot  that  ayoten  uhould  consist 
of. 

Wo  use  tho  term  "HPR  data  nystom"  to  represent  the 
following! 

(l)  basic  aoDumptions  and  goals  underlying  the 
cyotom; 

i'd)  definitions  of  data  elements; 

1)  a  otrunturc  for  claaolfylng  the  data  eletaents; 

4)  procedures  for  developing  a  data  bajik; 

5)  procedures  for  deriving  data  from  tho  bank; 

6)  procodui’ua  for  utilizing  thaso  ilata  to  satinfy 
oyatom  roqulroments* 

In  describing  the  HPR  data  system  it  le  necessary  to 
exw/iine  (a)  tho  fuhotlona  the  eyatom  ahould  perfons; 

(b)  tho  oyotem  dovolopnent  queatlons  It  ahould  answer; 
^c)  the  olomenta  that  the  data  aystem  should  Include; 
(d)  tho  roqulroriRn be  thn  ayotem  must  ijatlofy,  l^eae 
arc  d*;Gorlbed  bolow. 

Functions  of  tho  HPR  Data  System 

Bofore  developing  an  HPR  syatoB  It  Is  necessary  to 
ask  what  vo  expect  tho  system  to  do  for  its  users*  To 
aolvQ  tho  various  problems  encountered  by  system  devel4 
opera  and  tlw  operational  users  of  such  systems,  the 
HPR  syntom  should  posseso  both  design  and  predictive 
capabilities,  (it  should  be  pointed  out  that  If  tho 
only  people  who  were  expected  to  use  the  system  were 
hvunan  factors  specialists  and  reliability  engineers,  It 
might  bo  unnecossory  to  require  HPR  to  have  a  design 
capability) • 

1.  Doslgn  Capability 

A»  Aid  In  tho  allocation  of  functional  respoa- 
uibllltles  between  men  and  machines,  tberoby 
Duggcstlng  the  manner  In  which  a  nan-oachlne 
configuration  should  be  designed* 

B*  Aid  In  the  choice  among  alternative  man- 
loachlne  configurations  and  chsa*acterlstios* 

It  is  assumed  that  if  the  system  developer  knows 
whut.  human  perfarmance  can  be  expected  as  a  function  of 
the  manner  in  which  the  man-machlno  configuration  is 
designed,  an  appropriate  choice  con  bo  made  between  al¬ 
ternatives. 

Ar.DUKiing  that  certain  system  functlono  must  he  per¬ 
formed,  tho  deelgner  conceptualizes  various  ways  In 
wiiljh  these  functions  con  bo  Implemented.  The  HPR  data 
syutom  should  be  oblo  to  indicate  the  performance  ex¬ 
pected  of  the  poroonnel  In  each  alternative.  If  human 
perf'ormanco  is  ineufficlont  to  satisfy  system  requlre- 
mcntH,  the  function  must  be  Implemented  by  equipment. 

If  h«iman  performance  In  two  or  more  alternative  config- 
uraClono  will  botli  satisfy  system  requirements,  then, 
knowing  the  anticipated  human  performance  in  each  con¬ 
figuration,  the  developer  can  select  the  configuration 
whlcli  will  produce  the  more  efficient  operator  perform¬ 
ance  . 

2.  Predictive  Capability 
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Ai  Predlot  the  performoncf^  of  one  or  more  oper¬ 
ators  and  inalntonance  mun  perfomilnt  a  vari¬ 
ety  of  hehavloraJ  functions  In  n.  j.u  ion  to 
Bpcclflrd  etiulpHiuni  and  oyBLotn  conf-s-fiurn- 
tlone;  all  of  this  at  various  leveln  of  nyo- 

t.#»Tn  r-nmpl  i.y  4 

n.  Indicate  the  relatlonflhlp  of  operator  per- 
formance  to  overaU.  aystem  outputa.  At  any 
time  dui’lng  Bystom  development  the  'Jeveloper 
ehould  he  able  io  predict,  what  the  p.^rform- 
ence  of  oyatem  peraonnel  will  be  with  u 
given  man-n»achlns  configuration.  He  nondo 
to  do  tlilH  for  aeveral  reaaona: 

(1)  To  comiiare  alternative  man-mnch-lne  con¬ 
figurations  as  In  the  design  capability 
function  doscrlbed  above  and  to  Ueter- 
minc  which  design  characterlotlon  need 
modifl cation j 

(2)  To  compare  anticipated  huroan  porform- 
anco  with  that  required  by  the  ayotem 
to  dotoTmlne  ^ore  syatom  modificallono, 
if  ony^  must  hu  modoj 

(’l)  Whorrj  changes  In  oyatem  performance  are 
rcjqtiirod,  to  detcnalno  where  tliooe 
changua  ohould  be  made,  l.o.,  1n  which 
oyotem  olontunto,  Iho  cqulpmont  or  per- 
sonnul. 

The  HPR  data  system  also  Implies  (even  though  It  muy 
not  hft  staled  exjilicibi.'i^  oertuin  meaBuroment  charncterls- 
UcBi  Uy  upoeifylng  the  cilcfw»ntB  that  Influenced  per- 
oonnel  pcjrforrannce,  the  syatem  ingpllea  that  theco  oro 
the  olomento  which  ohould  be  meaourod  or  which  should 
be  taken  Into  account  during  the  measurement  process. 
For  oxamplo,  the  KPR  system  requires  a  specification  of 
the  charcetaristlcu  of  the  stimuli  and  task  porfomance 
charQctnrifltlcB  found  In  the  mcasureraent  situation. 
Therefore,  in  any  auasurement  situation  which  Is  to  bo 
uQod  to  provide  data  for  KPR,  or  whose  data  are  to  be 
romparod  wltl\  a  pr>*dlctlon  bunod  on  KPR,  It  la  nccou- 
I'ury  tu  (lesoriho  those  olomenta*  If  this  lo  not  done, 
the  data  gathorud  cannot  be  Integrated  with  HPR. 

The  i-equli'emont  to  aid  design  oolutlons  and  to  pi'e- 
dlct  performance  levies  certain  requlremento  on  the  UPR 
data  system.  In  order  to  uld  design  the  enowors  sup¬ 
plied  by  the  HPR  system  must  be  translatable  Into  de¬ 
sign  recoBuncndatlons,  l.e.,  must  be  usable  by  dgelgiers 
and  developers.  This  weono  that  performance  values  sup¬ 
plied  by  the  system  must  be  associated  with  not  only  on 
equipment  typo  (o.g.,  types  of  controls  and  displays  or 
Internal  components)  but  also  with  attributes  or  dlnon- 
slons  of  those  equipment  types.  One  must  bo  able  to 
predict  performance  nob  only  as  a  function  of  meteru, 
but  also  as  n  function  of  the  scale  on  the  motor,  the 
8l?.e  of  the  meter,  etc.  The  designer  wishes  not  only 
to  know  which  control/dlsplay  component  he  should  ao- 
■lect  but  also,  and  even  more  lnq)ortantly,  the  charac¬ 
teristics  he  should  Include  In  that  component.  Tills 
problem  has  been  recognized  before;  If  one  looks  at  the 
AIR  Data  Store  (Mungor  et  ul.,  19^2),  one  sees  that  the 
performance  values  have  been  partitioned  among  Indivi¬ 
dual  equipment  characteristics. 

Asouming  that  performance  data  ore  associated  with 
Individual  equipment  characteristics,  a  second  problem 
arises.  Kquipmoni.  Ic  usually  selectod  not  on  the  basis 
uf  the  Individual  fhoractcrlotlc,  but  rather  a  combina¬ 
tion  of  characteristics,  Asouming,  purely  as  a  liypo- 
thetical  example,  that  characteristic  A  had  an  operator 
performance  probability  of  .96  associated  with  It  and 
characteristic  D  a  performance  probability  of  .87,  what 
will  be  the  performance  probability  associated  with  an 
equipment  which  has  both  characteristics?  What  is  the 
effect  of  characteristic  A  when  combined  with  charac¬ 
teristic  B?  It  Is  unlikely  that  the  two  characteristics 


Qr*i  compJetcly  independiuit  of  each  other,  which  nu^^gseMi, 
as  Swnlii  (1967)  has  pointed  out,  thui.  a  aimp.l*j 
rutivi;  ri-iutiuiiuiai)  wuuiu  eo  uou  unpi  j  Lt  iv- • 

Tli‘j  uyntem  eonfiguratlon  the  d'lvelopor  Ic  ileal  Ing 
with  r--*iulroD  not  only  th«*  specif Icatlon  of  equipment 
uemponents,  but  also  number  and  typno  of  o]iinpovf-;u',  the 
procj-iiui'ua  they  should  ompLoy  in  r’mning  the  oyutom,  de¬ 
termination  of  training  content  and  diiratlon  and  the 
specification  of  work-ruiit  oycicu.  To  ihoouo  among  oj- 
toriml-lvo  mim -machine  conf IguratlonL.,  when  these  include 
looming,  mtinpownr,  etc.,  moons  thul  the  HPR  syoton  must 
provide  data  related  to  thou<;  paraiv-tors. 

In  addition,  since  the  system  the  developer  worto'. 
with  invoiveo  not  only  th«  single  operator  Interacting 
with  hla  equipment  but  groups  of  opf^rutorn  and  equlp- 
mento,  to  be  maximally  efflcJent,  one  muot  nupply  data 
roicvixni  to  multi-man  groups.  For  t.h.o  oaim?  r^sacon,  the 
prediction  one  uncks  is  a  prediction  of  pnrt’uriaance  of 
all  syutom  peraotuiul  functioning  to  accomplish  the  sys¬ 
tem  goal;  hence  HPR  oust  bo  able  to  combine  individual 
prediction  values  to  develop  a  prediction  of  that  goal 
ae  rompllohment • 

Obvlouuly  then  HPR  must  oupply  anawors  at  various 
levelfi  of  intorrogntion,  ranging  a]  i  the  wny  from  eem- 
ponetit  attributes  und  componontn  to  cubnyotems  and  syn- 
heran;  raid,  in  terms  of  thu  hchuviore  involved,  from  taok 
olotmmt.fj  (the  oingin  owlLeh-tlirowini'  activity)  all  the 
way  through  taoks,  procedurco  and  finally  f'aictlons, 

'J'ho  fact  that  total  oyatem  output  la  not  necessarily 
oqulval<nt  to  tho  performance  of  a  single  operator  or  a 
aingiii  function/taek  requires  HPH  to  Indicate  the  rela- 
tloniihlpo  to  oyr.tom  output  of  the  P'jrfonaance  of  the 
alnglo  tusk,  the  single  operator  wid  of  all  system  per- 
oonneL.  Tho  rules  for  combining  purformance  data  from  a 
lower  level  (o.g.,  task  oleraent)  to  oupply  a  higher  level 
(c.g.,  task  or  function)  performaiicc  prediction  are  quite 
obscure,  but  HPR  must  coniAin  them  if  It  Is  to  be  effec¬ 
tive. 

The  HTR  system  developed  au  the  output  of  the  pres¬ 
ent  ntudy  obvlounly  r'Annot  contain  oil  tlxj  featui  .a  des¬ 
cribed  ahuvu,  olnoe  considerably  morn  work  must  done 
bofovo  prublums  such  no  the  combination  of  task  predic¬ 
tions  and  the  prodiotlon  of  group  performance  can  be 
solved. 

3yBt<M  DeveVopment  Questions  HPR  Must  Answer 

iJince  vtt  aDoumo  that  HPR  cxlsto  to  supply  answers  to 
quQBtiono  raiued  during  system  development,  it  is  neces¬ 
sary  to  e;Q)lore  theue. 

I «  What  is  tho  operator* H  capability 
n.  To  perform  varloug  funotlono 
b.  Under  vaJ^lous  taplit  and  oriviromaental  condl- 
Tlonc?  ^ 

Tho  question  is  tho  basic  one  asked  early  in  system 
development,  when  the  problem  of  function  allocation  a- 
rlom;.  Given  specific  system  requirements  to  be  ful¬ 
filled,  will  tho  operator  be  able  to  satisfy  these  If  he 
lo  aooigned  the  function?  Assume  that  H  mossagea  will 
be  received  in  a  given  period  of  time.  If  tho  operator 
is  givr-n  the  reuponaiblllty  of  receiving  these  messages, 
will  he  bo  able  to  do  so?  Answers  to  this  question  will 
to  a  groat  extent  detenaine  whether  partlculSLr  functions 
are  allocated  to  an  operator,  because  If  he  esnnot  per¬ 
form  the  function,  an  equipment  solution  is  automatical¬ 
ly  requlx’eO. 

Obviously  the  question  cannot  be  answered  if  we 
think  only  of  a  general  function  such  as  message  recep¬ 
tion.  Wluit  about  message  duration?  Mesoage  format? 

Tho  manner  in  which  messagee  must  bo  received  ^«g.,  vis¬ 
ually  or  aurally?).  These  Involve  task  and  environmen¬ 
tal  conditions  which  must  be  linked  with  the  behavioral 
function  to  moke  the  functional  data  meaningful. 

It  la  apparent  that  no  task  element  in  HPR  really 
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has  tnui*h  moarilTig  by  ILue.U'.  If  ono  weru  to  uuk,  wtiat  iJ 
thH  offacL  of  mi  ii£iL4V'  t'oriii/if  on  ui'ei’utor  perfornu.uu'n, 
tho  ufiowur  would  b«>  rnlntlvoiy  iiieuiitnfjlt'nn  linlotio  r^Ia- 
ted  to  other  Intornotlve  tnt>k  ehara'-torUtU'u  ou'-h  hi- 
ru'Saatfo  longth,  mode  of  pror.enl ullon, 

Ao  M  t'omusiiii'ru'**,  p«:rronia.uv’t‘  valuon  uodLciutcd  with 

It.MvlciUJi]  r'j’.; !  '''•  ^'y>■^r.n  «i+ l  T'Umton  r»*nro-. 

only  nhntrnetloru]  t’rum  'in  exp-M’ime'ntftl  loot,  Wliiit 
(loon  it  moan  when  one  nnyt  ihal  perfurn^ioo  a;i  a  i’unt'- 
tlon  oi  cortulri  ocale  olkix’uoti'riutlon  jn  ,967.^?  For 
cunvenlenou  w  may  phj-uae  it  that  way  to  permit  cuicuJu- 
tlon  it*  Uuit  porforrmumo  offeot  Iti  intorantlun  with 
othor  porfummicu  ei'fecto  of  Indlvldufil  cliaracter lotion j 
hilt  what  'Wc  real  ly  morui  in  that  the  ofCool  of  ul.turing 
ii'Uilo  tdiara'‘terlni  Ii'ii  In  0  purtiouinr  wuy  ia  to  reduce 
hr  ult.or  oporu'uf  poi’t'ormhiuio  on  a  given  taok  with  a 
r.lvi'H  oTiulpmont  by  u  oort.aln  (iinount>  eg*,  #0027  or 
#0016..  Chnng(j  tlio  tank  or  i.'hmigo  t.ho  equipment  with 
ihuoe  name'  ncal"  <  hfirart.cr lottcn  nmi  tho  effei’t  of  thono 
fhwhcterlutl I'M  on  purfornani.o  will  be  ..IH7  or  .00003* 

In  order  to  pruvide  u  tnoonlngful  unawor  to  the  unor 
of  l-ht'  KPR  nyotnn  we  munt  therefore  aODoclutu  a  data 
Item  v1  t>k  ae  compl-'to  u  lU'HLTlrt.lon  an  potiBlblo  of  tho 
unt  Iru  tank  r’urfdi'mmu'e  context.  It  a.luo  meann  that 
tluit  datum  In  valid  only  for  that  porformanoo  context. 

In  othor  wordn,  it  In  noceunnry  that  u  given  human  per- 
fovnuineo  (e.g,,  .9713  or  5  OJTorn  in  100  trial n  01*  19 
Irlalr:  to  Jenm)  ho  unooclatod  with  n.lL  of  tho  tiuik 
rhai’uctovlntlcu  ref'-rrod  to  proviouoly:  the  bohuvlroal 
funrtinn  performed  by  the  human,  tho  nature  of  tho 
oquLpment  nood,  tho  environment,  the  natua-e  of  the  abim- 
ul  I  and  their  chariu’t'n’irtirLi,  tlie  oharu.:- tor  lotion  of 
the  nubjui't  porfurmlna  the  tiuik,  cto.  ThLo  ban  ina,!or 
impiictttlonu  for  thu  dovolopmont  of  an  IITR  taxonomy,  ao 
we  ohull  fine  latur. 

It  vrt.li  bo  objootcjd  that  this  ImpoaoB  on  inordinate¬ 
ly  difficult  rcqulroiikmt  upon  tho  HPR  aystora)  beauuee  in 
effoot  one  nouda  data  for  an  oxtremoly  large  number  of 
poncible  eombinutionu  of  the  above  taak  elonnnts.  Al** 
though  thin  lo  true,  vc  see  no  vuy  out  of  tho  dllcnna* 
novover,  it  la  not  aiippoaed  that  ono  has  to  uocuro  all 
the  nuceeaur^  data  at  onco.  Moruover,  a  coneldoruble 
amount,  of  data  Is  available  that  nan  bo  used  for  HPR  In 
ItH  doiUgn  capai'Lty,  even  If  they  cannot  be  uood  to  de¬ 
velop  a  (luaxitltat Ive  figure  of  merit. 

The  point  to  bo  remt'inbured  in  that  behavior  Id  not 
t’omponntl  of  reaponuen  to  diocrelo  entitles  like  ucaloa, 
Joystick  lenglhe,  ul.e,;  ihcoe  are  abstraetiona j  nor  con 
one  reoonnt.ltutu  muaii Lngfui.ly  homogeneous  perfomianoc  by 
synthoo Liilng  Lho  perfem-mre  values  aosoclutod  with 
thi^se  (ibobruct lono. 

All  of  the  pr«n?odlng  su{^goubo  that  to  bo  optimally 
efficient  IIPH  rauct  provide  data  at  vaiying  levels  of 
system  oomplexil.y,  vuiying  precision  tmd  in  l.or/nc  of 
varying  tnunoiu'en.  The  particular  'njua»-ire  eeioctod  la 
implied  by  bh''  nature  of  thn  funcbion/lauk  performed. 

It  is  conceivable  that  more  Ihiui  one  ineuaure  can  he  ap¬ 
plied  ^o  a  particular  function.  From  the  standpoint  of 
HPR  roqui roToentr,  li  Is  undonlrable  that  only  u  single 
metric  bo  available  to  HPR.  This  is  particularly  true 
In  relation  to  its  tioulgn  rupublllty.  Moreover,  that 
metric  must  be  nii'aningful  to  tho  aystom  developer  who 
uneo  HPR. 

u .  What  iu  the  effect  of  varlouo  typos  of  cqulpmeut 
character Ij Lien  on  the  uperator's  perfonimnce  of 
^eclflc  fmioliong  under  specific  tguk/envlron- 
mentol  coriditions? 

ABsumlng  that  the  uystem  dcvolopn’r  has  decided  t.o 
assign  the  renponnlbiltty  for  performing  various  func¬ 
tions  to  (in  opet-atur,  his  next  »ia,lor  stop  will  bo  to 
Identify  appropriate  rMiulpmeut  and  equipment  features  to 
Implement  tho  operator  function.  For  example,  in  a  hypo 
thetlcnl  Airborne  Command  Pout  uystem  it  bun  been  decided 


thai  ecrtuln  laetlcai  and  strategic  messagos,  a.g.,  air¬ 
craft  l.utujf3Sj  mlselicB  launched,  etc.  wlJ  1  be  displayed 
on  largo  ocreen  CRT.  Now  It  la  vinllkoly  tliat  the  de- 
cLaiun  Lo  employ  u  largo  screen  CtTi  wixj.  ue  biriclly  a 
functicjn  of  operator  performance  relative  to  CRTs,  but 
given  that  uuch  a  display  la  to  bo  used,  a  host  of  ques- 
t.lonii  ru'iiiu:  how  largo  must  the  symbols  be  to  ba  viewed 
aocumt.oiyj  wlukL  io  minimally  acceptable  rasolutlon;  hov 
liirpo  sliould  tho  scroon  bo 5  the  amount  of  ambient  light¬ 
ing,  etc.  Note  that  the  answer  provided  by  HPR  must  be 
in  relation  to  u  specif ic  function  porfonned  relative  to 
tht;  bocauuv)  tho  parformanen  values  one  derlvoa  from 
liPR  will  differ,  depondlng  on  whether  tlie  obaervar  Huat 
iiicaU*  ilata,  or  update  data,  or  analyze  the  displayed 
Information.  This  forces  u  relatively  high  dogroe  of 
n  poclf  icily  on  tho  ucer  of  IIPH  to  phj’ttso  his  inquiry 
j>rocloQly  if  ho  Is  to  recolvu  a  proclso  onswor.  It  also 
KHlulrf.o  of  HPR  tliav  it  supply  fairly  upeoiflc  answors 
10  qLj«irJ''ii  II’  Lhom:  answors  aire  to  be  useful. 

'3.  What  phyclcal  and  physiological  lltriltations  does 
the  o^orator  Impouo  on  equipment  doslgn  and 
fum^tU-in/task  ^rformaneJ?  What  envlronTna'htal 
flic  to  ri)  influonoo  design  and  performonco? 

Thane  quootionn  are  asked  during  detail  design,  la 
tho  phase  In  which  nquipment  chsLracterietlcD  arc  being 
developed,  lb  is  well  known  that  there  ore  physical 
(e.g.,  anthropometric)  Gonritraint(}  on  oquipiaont  that 
must  ho  tiiken  into  Account  dui'ing  design.  The  slgnlfi- 
c/uico  for  HPR  of  this  is  that  if  ve  Boy  that  HPR  must  be 
reoponDlvc  to  system  development  quontlona,  It  must  in- 
cUiUo  a  body  of  data  relevant  to  doolgn  even  though 
these  data  may  not  be  formulated  In  tc.Tns  of  a  pcTfonn- 
anco  meabuu'tj.  Au  a  consequenco,  HPR  might  Include  uu(ih 
Itenu;  us  u  table  of  reconmetided  control  or  diiipluy  sizes, 
oven  though  a  npoclflc  performance  equivalent  of  each 
controi/dlDplay  nizo  might  not  bo  available. 

4a.  How  adoguate^  will  tho  operator  perform  sped- 
flc  tanka  ^ncfer^arlDUS  taak/envirbnneht^  con- 
dltlong? 

b .  How  io  th(S  porfomaneg  affocted  by  varioua 
uqulpnKjnt~oW*acterl8tlcBT~ 

This  bvu-part  question  is  on  extonsion  of  question 
(l)  which  dealt  with  operator  capability  to  perform  nx^ra 
genomi  functions,  quostion  (4>»)  deals  with  tusknj  In 
the  more  detailed  aupoctn  of  design  HPR  answers  phrt\Qod 
ill  function  tonus  (as  they  would  b(j  for  question  (l)) 
would  bo  Inudoquato. 

5.  What  is  tho  effect  of  dlfforont  onounts  of  man- 
powor  on  performance  of  an  individual  taskt  Of 
multiple  taokfl? 

One  of  the  problems  the  system  developer  encouatera 
Id  the  roquii'oment  to  detcrmlno  tho  number  of  personnel 
iKjedud  to  perform  individual  or  combinations  of  tasks. 
Does  a  syatum  requira  a  two-man  crew  or  throe  non?  Al¬ 
though  the  dubormining  factor  In  solving  this  problem  is 
tho  otructure  of  the  system  and  the  task,  HPR  might  help 
in  vurLfylng  whatever  decision  (as  to  crow  size)  is  made. 
Tho  same  mon-machlno  configuration  with  two  different 
crew  ni/.oB  could  be  compared  In  terms  of  the  perforooncG 
to  bo  oxptictod  with  oach  crow  size. 

6.  How  does  the  performance  of  one  task  affect  the 
porformanoe  of  a  secuncT  tauk  whi^h  occura  dither 
concurrently  or  sequentially^  How  is  this  task 
performonco  interrelationship  al^focted  by  varloup 
typos  ^f  tooks  and  task  condition^? 

Tills  description  of  HPH  requirements  has  until  now 
dealt  largo Ly  with  Individual  behavioral  units  (either 
functions  or  tanks)  but  obviously  such  a  limitation  uev- 
eroly  rtiducoD  tho  u.aofulnesn  of  tho  KPR  oysten.  In  or¬ 
der  to  predict  tota.1.  aystnin  porformanco  (the  goal  of 
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jrpR'u  predictive  rupablllty)  It  will  bo  noceauary  to 
iTombine  tank  wid  equipment  perfonnancQ  valuoBi 

TUe  lypon  of  combinations  the  final  IIPR  r.yatcm 
enould  be  ahlo  to  hundlo  are; 

a.  multiple  equipment  choraotorlntlcfl  within  the 
B&aio  oqulpmcnt) 

b.  multiple  taak  elomcntn  within  the  uame  Uiukj 

c.  tho  Inturacilon  of  equlpiuent  and  bfthuvlornl 
furiftlnruj  In  a  nlri{.^lu  taulj 

fl.  tlio  Intemcllon  of  niu.ltlplc  concurrent  and  ue- 
quantla.l  taakoj 

n.  lh«>  IntojactLon  of  modifying  tank  condltlonu  and 
olnglf*  mid  multiple  tanko, 

Tho  quoatlono  tho  combinatorial  procooa  ohould  bo 
able  to  fuiowar  are: 

ft,  Wliut  111  l)nj  ul’  pu?‘r{jrmiii(/,  twt;  or  more 

laaka  acmcurrontly  nnd  the  ronultant  pei'fonwuico  value? 

b.  For  any  uorloo  of  Intorralatod.  bohuvlorul  unltS/ 
vhftt  lo  the  porforni’irco  value  to  bu  oxpoctod  when  tho 
Bcrlen  i  q  oompl.otcd  by  tho  oporator? 

c.  Whnt  In  thu  .volationnhip  botwoon  the  expected 
porforraancQ  of  any  hohavloral  unit  ujid  tho  final  per- 
formancu  value  found  Ir*  (b)  above? 

The  oyetom  dcvolopor  wilJ  fJnd  thia  Infurimtlon  uoc- 
ful  lf«  for  (a)j  he  in  trjMng  to  decide  whether  n  Rlvon 
behavlurnl  unit  ohould  bo  performed  concurrently  or  ne- 
quonLlullyj  for  (b),  if  ha  WFuitu  to  deteimine  witobher 
opnralnr  perfoimianec  of  tho  entire  nyotcni  vlll  oatlufy 
ayutnm  requii’ementa ;  foi’  (e),  If  he  wimtfi  to  loiow  wheth¬ 
er  modifying  any  nlnpilo  bcliavloral  unit  will  prodtioo  a 
lilghor  or  lowin'  ryntum  output, 

Thu  ootablluhmoiit  uf  cuinUluatorlal  nice  lu  the  moot 
complex  tuuk  roqulred  in  tho  dovnlopmant  of  the  ultimate 
ItPR  oyutem,  Wc  do  not  protend  to  have  anawered  thie 
qunutioh  in  tho  pr<’Uunt  rtudy. 

doon  thu  operator 'o  perfotmnoo  vary  as  a 
function  o^t*  ropoatad  trlalo  Int  Xoarnlug  to 
perform  the  l-abKi  porformln^tne  Iciornod 
lank  « gTi  )?  * “ 

During  dotull  doeign  thu  developer  ia  faced  with  tho 
problem  of  dotuttninlng  how  much  training  ahould  bo  pro¬ 
vided  l,hc  operator,  Training  dui’ation  I0  influenced  by 
the  highest  dogreo  of  parfoimumeo  vlilch  one  eon  o)q)oct 
BO  a  function  of  repeated  learning  triala.  The  tiuocimum 
proflcluncy  exjjucl.ed  of  tho  operator  can  aloo  aorvo  as 
U  IKirformancc  otundard  which  will  uaelat  In  netting  up 
eyntum  roquiromento. 

In  many  oystum  appllcBtlona  the  developer  Is  oou- 
cantied  about  the  offeot  of  futlguo  on  porformonoe,  par¬ 
ticularly  1n  torins  of  determining  on  optimal  vork-roat 
cycle.  Fatigue  may  ho  reflected  in  increaoing  perform- 
iineo  variability,  incroasod  errors;  etc,  Since  porform- 
oneo  degraden  no  a  function  of  time;  KPR  should  opocLfy 
thu  amount  of  that  degradation  that  can  be  expcctAid. 

It  iu  upparent  that  to  uupply  onevers  to  all  tho 
quantluno  wlilch  one  would  vloh  to  ^inevor  grout  mniiuou  of 
data  muni  l)0  enbi.’roci  Into  the  IITB  oyolora.  Miuilfontly 
prcnont.ly  uvailah.l«:  IIPR  daba  hruikn  cannot  nupply  thnoo 
data}  hence  other  noui'coo  ere  needed,  which  Lo  of  couroe 
the  polr\t  of  tho  prouent  study. 

IIPH  System  Elenn»nta 

A  review  of  the  oyutem  <levolopment  quoatlonu  which 
KPR  muet  answer  nuggooto  tho  elomonto  that  HPR  muot  con¬ 
tain,  These  Ini’lndej 

1.  Definitions  find  taxonomic  categorlzotionn  of 

a.  bohaviornj 

b.  equlpmente  and  equipment  characterietico; 

c.  otlmulun  characterloticfl; 

d.  raodifying  paromotoro  5 

e.  i'ouponue  muchoniuroa  and  neauurQu; 


r.  environmontal  faotorflj 

g.  jw^rnonnel  rharactertoticn . 

?.*  Porformaucs  data  deunrlblng  the  ltt»nic  llnted  In 
(j.)  auovc.  rniu  lu  uic  iirit  uiiXsa  uanti. 

A  fflutric  or  vreiy  of  expreueing  IIPR  autputtu 

ht  Rtilflft  of  op.»rtttlonB  for 

a.  Interrogating  the  }£PR  data  syatem; 

h.  retrieving  data  from  tho  HPR  oyutem; 

f.  outputting  JIPR  data; 

(i.  combining  performance  vnlueo; 
u,  oxlraijolatlng  or  genuralj  r.lng  new  ilata  fro* 
already  availFi\)1e  data. 

HPR  ayntom  Requlremantfi 

The  following  Hut  doucribes  thuao  rf»qulreiik*nta 
which  the  HPH  oyutem  rauat  eatlefy  If  It  in  to  provide 
Uii-  fum-tlotid  ruforred  to  provlously.  No  pui'tlcuiar  or¬ 
der  of  priority  j«  Implied, 

1.  Porfomirinco  data,  in  u  variety  of  appropriate 
metrlcn,  munt  bn  capable  of  being  naooclatnd 
with  u  variety  of  oomblnatlons  of  raan-machlne 
r!lenii.>nt,u. 

HPR  data  must  bo  capublu  of  being  retrieved  for 
each  nuch  man-machine  combination,  'llio  retrie¬ 
val  proootm  muut  nut  bu  Inordinatoly  lengthy. 

1.  Pufinlt  one  and  CMlugorlen  the  oyatc  m  ele- 
menta  must  ho  in  termo  that  are  meaningful  to 
nyotom  dovulopnient  uEjcnu 

h,  I’lntiy  to  tho  HPR  nyotem  muBt  be  relatively  eaoy 
und  mutd,  bo  capublo  of  being  accompllahud  for 
each  uyntom  eloiaunt  und  element  combination. 

5»  The  system  munt  contain  ruioe  for  combining  per¬ 
formance  vulues  to  diuiorlbe  total  ayatem  output, 
Tt  must  poBDOBQ  rules  that  permit  modiricatlon 
of  performance  values  for  nomo  oyatem  elements 
by  the  Incluolon  of  other  elnmontt}  in  iho  behav¬ 
ioral  unit,  0*5*,  determining  tho  srfe''‘t  of  uiib- 
ntar.dFird  lighting  on  porfonnanoo  of  a  legibility 
tank, 

6»  The  oyotom  must  accept  data  from  a  variety  of 
ooureoo  including  tho  goneral  behavioral  liter¬ 
ature  , 

V,  Ultimately  thu  ayotera  should  have  the  capability 
of  generating  additional  data  untriou  to  Its 
ctoro  by  cxtropolatlng  from  or  othervloe  modify* 
Ing  data  already  within  thu  syetem* 

6.  Ultlmutoiy  the  eystora  should  have  the  capability 
of  Blatlstlrally  unaiyulng  Its  data  In  responee 
to  requento, 

9,  At  leant  part  of  the  HPR  data  muot  be  capable  of 
bfjlriK.  combined  with  equlpiiif'nt  reliability  pro- 
dlellvc  dutu» 

Alternative  IITR  Data  BarA  Formata 

A  deta  b:uik  la  not  0  imply  a  data  bank,  although  that 
Inqpreuulon  huo  dovcloped  over  tho  yearn.  It  in  posaiblS 
lo  dlnllnguloh  flvo  typoo  of  bunko  »md  two  types  of  us¬ 
ers  of  thono  bunkn, 

Tbi?  firnt  typo  of  data  bonk  ia  wliat  can  be  termed  a 
probability  ntatoment  of  tank  perf orinance .  A  sonrplB 
lium  mU'Ut  hot  tTwT  probabTlTty  of  throwing  a  double- 
pole,  douhle-thi'ow  switch  correctly  lo  ,9^8.  Note  that 
this  otat<*mont  oayn  nothing  about  the  characterlotlca  of 
that  switch,  other  than  Ito  dcoigjmtlon,  end  doou  not 
apply  fi  probability  ututemont  to  Lhooc  cliuractcristlcrt. 
Table  1  (taken  from  Blunchiurd  -^t  al.,  1966)  reflects 
burh  u  data  bunk, 

A  second  typo  of  data  bank  would  conalot  of  proba¬ 
bility  ntateitkm tn  auoocigtcd  vi th  iipeclflc  equipment 
elau'gc  Loris  tics.  For  QXamplo,”tKo  probability  of 
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•nrr«ctly  operating  a  .luyet-I^'k  oontroL  of  eMck  Icnf^ih 
6'’-9''  Ib  *9^^;  th<‘  probability  of  rorr  ot.iy  opcruti/v^ 

lovqf.lr'k  with  R»in  ll>«.  cfint.-ml  T»»fl  I  In 

•  9999i  Not'-  t.hat  there  in  no  uirigle  performance 

probability  aasoulat.od  with  i.ho  task  of  Joystick  oper¬ 
ation,  only  vlth  equlpmunt  r'Uamotcrlctlca,  althounh 

tliei't;  In  iiu  I'uiinCili  Vliy  tiio  LWu  ouald  iiot  u- -  «-ulu<j i iirjd  • 

The  cloaeie  examplo  oT  ouch  a  data  bank  lu  the  AIR  Data 
Store,  or-vernl  i  teme  from  vtilch  .-itc  ahowi  Ir,  TtibLo  2. 

A  thlr'l  typo  ui  Jala  Lank  '‘ould  ejonsist  of  the  raw 
performnnee  valm?i;  assoclatod  -with  partleulai*  pornme- 
tero.  Table  3  prc.'ientsj  an  Illustration  of  ouch  a  data 
bank  format.  Note  that  the  data  ohown  In  the  table  are 
nut  prenor  Lod  In  a  p’'cbabliistlc  fanhion,  although  the 
error  data  could  precumably  be  transformed  Into  proba- 
bllltl'-n.  Presumably  data  would  bo  selected  to  illus¬ 
trate  th*-*  dcoirablltty  of  ceif'cting  one  or  the  other 
depign  charactcrlatle*  For  example,  in  the  Item  deal¬ 
ing  wU.li  TV  rcoclutlon,  It  would  seem  reasonable  tu  the 
designer  that  if  one  wished  near  perfect  obeorver  ros- 
poneo,  between  7i8  and  13»5  ccon  linos  would  be  re(iulr- 
ed  wlih  eymbclo  10. Jl  minutes  in  alze. 

A  fourth  typo  of  data  bank  could  conslot  of  quanti¬ 
tative,  n on -probab 1 1 iu  t i c  statements  related  to  speci¬ 
fic  equipment  charactorlstleb.  For  example,  a  sample 
Item  might  be:  dinplay  format  X  will  produce  1«658 
times  mor')  effect Iv*'  performance  thfm  dlGjjlay  format  Y 
(X  and  Y  differing  In  specified  ways).  The  ctatoraent 
con  be  quantitative  or  qualitative;  could  use  an  arbi¬ 
trary  set  of  scale  values  to  represent  relative  per- 
fonnaiice;  or  one  could  use  a  rating  scale  or  ranking. 
Table  4  proeoncr  u  sample  set  of  data  bank  Itemo  ol 
hi  a  lyin'. 

A  fifth  type  cf  data  bonk  format  and  one  which  Is 
personally  most  appealin'  on  purely  heurlatic  grounds 
would  combine  all  the  characteristics  of  the  preceding 
formate'..  Such  a  format  would  provide  to  the  user  all 
tho  data  available  In  whatever  form  It  could  be  provid¬ 
ed^  whether  or  not  the  data  could  be  foraulutcd  proba- 
bllieticaliy.  Thus,  probabllletic  values  vould  be  us- 
sccluted  with  certain  taskr.  and  task  characteristics^ 
where  such  values  were  available  j  raw  perfonwnce  data 
for  other  task  paranotero  would  bo  supplied  when  prob¬ 
abilistic  information  could  not  be  supplied.  Table  5 
presents  on  lllustrat.loii  of  such  a  data  bank  item. 

The  two  types  of  customers  who  might  make  use  of  the 
various  data  banks  are,  besides  the  hxioian  factors  spe¬ 
cialist,  reliability  engineers  and  design  engineers* 
HlstoTlcally  tho  concept  of  the  HPR  data  bank  was  de¬ 
veloped  out  of  the  reliability  engineering  tradition 
which  lias  emphasised  prediction-  hence  the  need  for 
probabilistic  statements ,  I'he  design  engineer,  how¬ 
ever,  Is  not  so  much  cone,  med  with  prediction  as  with 
the  selection  of  one  design  concept  or  characteristic 
rather  thor.  another.  Wliat  this  means  is  that  he  consi¬ 
ders  a  number  of  alt<>mative  deslgit  cbaractcrlsbics  and 
decides  that  one  of  these  will  give  him  more  effective 
performance.  He  does  not  require  probabilistic  state¬ 
ments  because  his  choices  are  all  relative. 

Getting  back  to  the  data  bsnk  formats,  the  first 
typt-  of  data  bank  is  not  likely  to  be  much  use  to  a  de¬ 
sign  engineer  because  it  does  not  specify  equipment 
characteristics,  which  is  what  he  is  interested  in. 

Data  bank  types  1  and  2  differ,  moreover,  in  the  ease 
with  which  they  crui  bo  secured,  Tho  first  type  of  data 
con  br*  BocuTcd  from  almost  any  kind  of  testing  in  a  nen- 
luboratory  envlronm(?nt  and  requires  no  special  control 
situation.  The  second  type  of  data  bank  can  be  derived 
in  two  ways.  It  can  be  derived  from  the  non-laboratory 
test  situation  in  which  the  first  type  was  secured, this 
can  bo  done  only  if  the  operator's  performance  can 
be  partialled  out  to  reflect  the  Individual  equipment 
characteristics  he  is  responding  to;  or  if  a  sufficient 
number  of  different  equipments,  each  one  representing  a 


dlotlnci  oqulpiiicnl  characteristic,  can  be  tested.  Thgn 
ono  I'Hii  ilcvclop  the  second  kind  of  data  bank.  However, 

hhlr  I r:  vn-rv  tUfflpiilt.  +n  dn  In  a  t*AlAt.lvelv  iinpontml- 

lod  non-Jaboratnry  aituatlon,  since  tho  operator  res¬ 
pond:;  lo  Lho  entire  equipment,  rather  than  to  an  Isolat¬ 
ed  equipment  charaeterictic.  Moreover,  In  the  opora- 
tloual  pt;L'foxviaiiC<j  ultuatiori  the  iiuiuber  of  dlstlriCtly 
different  <-qulpm''ntfl  that  can  be  tested  is  limited.  It 
iippcurr.  i:hererorrt  that  it  would  be  difficult  to  secure 
the  uooond  kind  of  data  bank  from  non -lab oratory  test¬ 
ing. 

Another  'my  of  securing  data  for  the  second  kind 
of  data  bank  is  from  laboratory  studies,  If  the  e]q>srl- 
menter  has  specifically  set  up  controlled  situations 
that  contrast  two  or  more  different  equipment  character¬ 
istics.  Tho  experimental  situation  must  therefore  be 
dircctod  at  the  Individual  characteristics  being  compar¬ 
ed,  rather  than  at  the  equipment  as  a  whole.  This  is 
precisely  what  a  laboratory  situation  is  designed  to  do* 
However,  the  inadequacies  of  present  data  banks  reflect 
tho  fact  that  many  (if  not  most)  laboratory  studies  do 
not  contrant  all  the  desired  equipment  characteristics. 

One  con  use  tho  second  type  of  data  bank  for  design 
decioionc,  but  tho  engineer  does  not  make  use  cf  the  ab¬ 
solute  value  of  the  probability  atatoment  for  this  pur¬ 
pose.  If  one  Joystick  length  gives  .99^  pcrfomance, 
whereas  a  second  length  gives  .8968  performance,  then 
the  deolgner  implicitly  or  explicitly  ranks  the  two 
characteristics  (lengths)  and  selects  the  one  with  the 
higher  probability.  It  would  make  no  difference  to  the 
designer  if  tho  absolute  performance  probabliitieB  were 
dlffcr»-*nt,  ao  long  ao  th''  two  lengtho  retained  their  re- 
lativt;  p'^rforrviiice  .“landing,  nor  wouJ.d  it  make  any  dlf- 
foronco  to  tho  designer  if  the  two  characteristics  were 
almply  ranked  1-2,  although  he  would  probably  want  sup¬ 
porting  data  to  back  up  the  ranking. 

Data  for  the  third  and  fourth  types  of  data  ba&kfi 
can  be  cocured  from  the  uvallable  results  of  e3q>erl]Ben- 
tal  studies  and  are  moreover  easier  to  develop  than  ci¬ 
ther  the  two  previous  banka  because  they  do  not  require 
that  their  data  be  transformed  Into  probabilistic  val¬ 
ues.  Unfortunately  much  of  the  general  behavioral  data 
cannot  be  adapted  to  probabilistic  statcaects  because 
they  use  such  m  .’asurcs  as  reaction  time,  response  dura¬ 
tion,  trials  to  learn,  etc. 

All  things  considered,  the  third  and  fourth  types  of 
data  banks  ore  easier  for  the  design  engineer  to  use, 
they  will  provide  more  back-up  information,  and  one  can 
build  up  a  larger  data  store,  because  data  from  the  lit- 
eratur'j  tliat  could  not  be  used  for  the  other  more  re¬ 
strictive  types  of  data  banks  could  be  used  for  this  one* 

Wc  do  nvt  sugguot  that  one  must  accept  either  prob¬ 
abilistic  or  non-probablllstic  data/statoments*  It  is 
conceivuble  that  both  are  needed.  It  is  possible  that 
the  determination  of  human  capability  to  perform  and  the 
conpsrison  of  alternative  man-machine  configurations  In 
terras  of  mission  requirements  will  require  the  tradi¬ 
tional  kind  of  probabilistic  HPR  data.  On  the  other 
hand,  the  identification  of  equipment  and  the  aelectioo  • 
of  most  desirable  equipment  characteristics  will  not  re¬ 
quire  probabilistic  data  but  can  take  advantage  of  many  . 
other  kinds  of  data. 

It  would  seem  that  a  reasonable  compromise  emomg  the 
potential  data  bank  formats  would  be  that  shown  in  ^bla 

Thin  format  takes  maximum  advantage  of  all  possible 
data  Gourccs  and  includes  all  the  possible  data  state¬ 
ments  as  they  become  available. 


The  HPR  Toxonom 


The  HPR  taxonomy  shown  In  Table  6  was  developed  on 
the  basis  of  two  premises.  First,  the  studies  to  be 
classified  should  be  classified  In  texmia  of  all  their 


relevant  parameters.  Second,  the  taxocooiy  should  be  an 
empirical  one,  based  on  the  variables  actually  included 
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In  the  studies  whose  data  are  to  be  extracted.  However, 
the  taxonoi^y  Ic  not  open-ended;  a  category  wae  not  add¬ 
ed  ilmply  becauce  an  cxporiitionter  decided  to  invcwtigate 
It,  but  because  that  category  wan  required  to  annwer 
Dyotem  development  quostlono  ptiraoed  In  HPR  terms. 

t.nYnnomy  1r  not  to  he  ^oranlnte:  if  a 

Btudy  ie  found  whose  variablea  cannot  bo  claasiflod  ac- 
corvdlng  to  the  taxonony  aa  1 1  now  exists,  new  oategorled 
must  he  added.  The  taxonony  la  not  Infinite,  of  course; 
lifi  more  and  more  studica  arc  examined,  the  number  of  ad¬ 
ditions  to  the  taxononv  hecomo  fewer. 

The  numbering  system  in  Table  6  Is  sorasvhat  Irregu¬ 
lar.  The  reason  for  this  is  that  ss  new  categories 
emerged  from  examination  of  the  data  sources,  they  were 
Dimply  added  to  the  preceding  categories. 

The  categories  Included  in  the  taxonomy  arei 

A.  Perceptual  funetlona  (visual  scanning). 

AB.  Audltoxy  perception. 

T.  Tactile  (one  study  was  found  that  utilized  tac¬ 
tile  stimulation,  and  It  lo  conceivable  that 
this  sensory  node  might  be  used  operationally). 

B.  Discrete  motor  tacks  (individual,  distinct  oper¬ 
ations). 

C.  Contlnuoun  motor  tunkn  (contlriulng^  Integrated 
oequencG  of  control  operations). 

D.  Cognitive  functions  (higher-order  decision-mak¬ 
ing  operations  not  suheiuoed  under  or  required  b;; 
preceding  perceptual/motor  operations). 

£.  Cofiifiiunicatlona  functions  (person  to  person  com¬ 
munication,  either  face  to  face  or  by  instru¬ 
ment)  . 

Each  of  the  above  functions  may  roprecant  a  single 
task  or  multiples  of  tasks,  depending  oa  the  study  con¬ 
text.  Earlier  vo  hnd  tried  to  differentiate  between 
toolecalar  and  molax*  tasks  and  to  develop  a  separate 
closaiflcatlon  for  each,  but  this  proved  abortive  be¬ 
cause  of  the  high  degree  of  overlap.  This  may  present  a 
difficulty  for  the  predictive  uae  of  HPH,  but  not  for 
its  desiffi  use. 

F.  Visual  stimuli,  or  what  Is  displayed  to  the  sub¬ 
ject. 

O.  Auditory  stimuli,  or  vhat  la  presented  aurally 
to  the  subject. 

H.  Display  equipment,  or  the  sources  of  otiniu].i  In 
(F)  and  (O). 

!•  Control  equipment,  or  the  mechanism  used  to  res¬ 
pond. 

J.  Subject  variables  (age,  sex,  training,  exper¬ 
ience,  etc.). 

K.  Response  measure  describing  the  subject's  per¬ 
formance  (e.g.,  error). 

Some  of  the  above  variables  will  be  found  In  every 
study,  while  others  may  or  not  occur  in  a  study  depend¬ 
ing  on  the  nature  of  the  experimental  situation.  How¬ 
ever,  the  categories  below  would  definitely  not  be  In¬ 
cluded  In  the  classification  of  a  study  except  where 
they  were  8lgnlflf*ant  factors  influencing  that  study. 

L.  Bivlronmental  factors,  eg.,  acceleration,  tem¬ 
perature,  lighting. 

M.  Stimulus  characteristics  or  distinctive  features 
of  the  stimuli  which  could  have  influenced  the 
subject's  perfc rmance. 

N.  Control  characteristics  or  distinctive  features 
of  the  control  equipment  i^rtilch  could  have  In¬ 
fluenced  the  subject. 

0*  Performance  task  factors  or  characteristics  of 
the  task  situation  which  either  could  Influence 
the  subject's  performance  or  which  describe  the 
manner  in  which  the  studj'  was  carried  out.  Fi¬ 
nally, 

P.  Study  subject  matter,  the  general  theme  of  the 
study  to  permit  Its  more  easy  retrieval.  For 


example,  if  one  wen*  interested  solely  In  studios 
of  flying  performance,  such  n  ciao8ifl(!atlon 
would  maJCQ  It  casi'ir  to  re'^'vi.cve  studies  on  that 
flubjoct. 

One  thing  uhould  be  Itimcdlately  clear  about  this  tax- 
unom.y.  II  Lt<  puitily  deucrlptlvo,  roakliig  no  ssaiinptluos 
about  underlying  processes.  Consequently,  In  determin¬ 
ing  Its  "valldiLy",  the  only  criterion  io  its  useful¬ 
ness;  one  cannot  appeal  to  concepts  like  "construct  va- 
J Idlty". 

Three  processes  are  involved  in  the  dcvelopoaent  and 
use  of  the  HFR  data  system.  These  are: 

(l)  Classification  (coding). 

a.  The  classification  of  the  study  provided  by 
the  HPR  developer,  l.c.,  the  taxonomic  categories  as- 
olgnod  to  the  actual  data  in  the  HFR  data  bank. 

b.  The  oiaBfiification  developed  by  the  user  of 
the  oystem  ^cn  ho  asks  a  question  which  the  system  Is 
supposed  to  answer.  The  question  for  which  the  data 
oystcin  Is  Interrogated  must  be  coded  %rith  the  same  tax¬ 
onomic  categories  used  to  code  the  original  data.  The 
search  for  a  match  between  these  two  clasBlflcations 
repreoents 

{?.)  The  retrieval  of  data  from  the  systeoi. 

(j)  The  combination  or  integration  of  the  data. 

Development  of  the  HPH  Data  Bank 

The  incorporation  of  any  data  into  the  HPH  system 
obviously  requires  first  the  selection  of  the  studies  to 
be  included.  The  criteria  used  to  select  studies  were 
essentially  eliminative.  Tbut  is,  all  data  sources  wore 
included  except  those  that  used  infra-humoas  (e.g.,  rate, 
apes)  or  ohUdr<.‘n  as  subjects;  or  had  no  usable  quanti¬ 
tative  data;  or  in  which  tlie  subject's  responses  were 
primarily  physlolccical,  because  we  cannot  tie  physiolo¬ 
gical  responses  to  equipment  design;  or  in  which  subject 
responses  were  those  required  by  formal  written  teats 
like  Intelligence  tests;  or  in  which  stimuli  and  task 
conditions  were  subjectively  oriented  like  personality 
studies;  or  In  which  it  is  very  difficult  to  understand 
what  the  experimental  procedure  was;  or  In  which  the 
number  of  subjects  was  less  than  4. 

In  general,  for  a  study  to  be  used  as  source  meterlsiX 
it  had  to  include  some  behavior  which  was  credible  in  a 
man-machine  context,  that  is,  the  tasks  performed  by 
subjects  could  conceivably  be  perfonsed  In  real  UTe,  or 
bore  on  some  aspect  of  real  life  activity.  Of  course, 
this  Involved  a  certain  degree  of  subjectivity  in  making 
choices,  but  this  was  unavoidable. 

The  procedure  for  coding  a  study  la  aysteoatically  to 
go  through  t.ho  list  of  categories  in  Table  6,  deteimiae 
which  categories  apply  to  the  individual  study  and  re¬ 
cord  the  alphanumeric  designations  of  these  categories. 

Within  any  major  category  (A,B, C,  etc.)  any  number  of 
subcategories  (l, 2, 3»  etc.)  can  be  applied  If  they  are 
relevant.  This  is  true  even  for  apparently  exclusive 
categories  where  a  number  of  conditions  >iave  been  inves¬ 
tigated  in  the  same  study.  For  example,  It  Is  possible 
to  have  some  subjects  who  are  esqperienced  In  the  experi¬ 
mental  task,  while  others  are  not.  Many  of  the  descrip¬ 
tors  for  the  data  in  thu  HPR  system  contain  multiple 
subcatogories,  because  most  of  the  studies  are  multi¬ 
variate  in  nature. 

However,  the  Intent  is  to  record  only  primary  func¬ 
tions  and  parameters,  not  merely  those  that  are  indica¬ 
ted  in  the  study  description  slnqply  to  supply  Informa¬ 
tion.  For  cxan^le,  the  study  report  may  Indicate  that 
viewing  distance  from  a  display  was  ik  inches.  However, 
unless  viewing  di6ta»nce  was  a  treatment  variable  and 
data  were  recorded  relative  to  viewing  distance,  this 
Infornatlon  would  be  Ignored. 

The  end  product  of  the  classification  process  la  what 
VB  call  a  aooorlptor,  eg.,  AZ/BZ/FI^/hi/JZ/KI/MU/PT,  to 
Which  Is  added  the  index  number  of  the  original  study 


7 


abRtraL:t. 

The  prellnLinary  HPR  data  bank  doVflopcd  for  thlo 
nt.udy  in  baaed  on  l40  ntudioH,  none  of  which  waa  uaed  In 
prevlouo  da^.a  bonki-.  A  com^aoi^r  oT  i»»u  ^.x-uiiLvu, 

tOijQther  with  the  doocrlptoro  for  each  ctudy.  can  be 
found  In  the  final  report  wiiich  cerved  na  the  baoia  for 

t.hifl  papi'r. 

Uae  of  the  TIPR  Data  Syatom 

In  fidflltlon  to  the  ciaauJ fl eatlon  Impoaed  on  tho 
data  Itcma  In  the  llfH  data  Uunki  the  user  of  the  Ayotem 
impoDOB  hJs  uwn  cJ nonlf Iratlon  by  the  pre  ;lelon  with 
which  he  t’rawon  a  question  to  be  anawored  by  the  ayatcni* 
Thu  liner  may  ank  a  very  global  que?atlon.  c.^^,  whut  hu¬ 
man  performance  can  be  expected  with  dloplayu;  or  he  can 
frame  hln  quuntlon  much  more  proolaoly,  e.g.,  what  is  tho 
<;peoU  of  (Joi.-'ctlrig  radai’  plpu  on  PPI-lype  dlcplay'? 

Thi-  fCPR  eyatum  munt  be  reaponolvo  to  both  typeo  of 
queottone.  Of  courue,  the  more  prcclce  the  question* 
the  greater  the  prccloion  of  the  Information-retrieval 
and  the  more  relevant  are  all  the  etudiofl  retrieved. 

The  oyatem  will  obviously  not  accept  a  question 
phrased  in  English.  That  question  must  be  transformed 
Into  taxonomic  equivalents.  Ad  an  example,  consider  the 
following  question: 

How  accurately  can  an  operator  detect  either 

vio\ial  «nd/or  auditory  signals  over  long  periods  of 

monitoring? 

This  in  anai.y7.Gd  ad  follows: 

(l)  DeU'Otton  of  a  visual  signal  Is  coded  Al. 

?)  Detection  of  an  auditory  signal  is  ABl. 

;j)  No  mo'or,  cof^ltlve  or  conmunlcatlonQ  functions 
h'lvij  boon  Mpeoiriod,  so  we  Ignore  those.  Nor  do  we  have 
any  Iduu  as  to  the  characteristics  of  the  signals,  nor  of 
the  dlaploy  equipment. 

(4)  Accuracy  J.s  a  rather  general  noasurc*  Because 
of  Its  non-opeoif lolty,  we  have  to  Include  a  number  of 
categorlua  that-  might  apply:  Kl,  4,  24,  Zlf  28,  30. 

(5)  Long  periods  of  time  have  been  specified.  This 
is  category  0,  and  eubcategorlcs  X,  2,  3,  and  4  might 
wJy* 

(6)  The  subject  matter  of  the  studies  tu  be  re* 
trleved  in  answer  to  the  quention  In  monitoring/detec¬ 
tion,  wfiich  la  category  PIO. 

Consequently  the  descriptor  of  the  question  roads: 
Al/ABl/Kl,  4, 24,  27,  20, 30/01, 2, 3»  4/PlO 

In  uttemptlufj  to  answer  the  original  question,  the 
HPR  system  operates  on  the  basis  of  progressive  sorting 
through  the  various  eategorleo  to  achieve  the  closest 
possible  match  with  the  entry  descriptor  (the  user's 
question  phrased  In  teiTis  oi'  the  c.lasoiflcation  cate¬ 
gories)*  Because  all  studios  not  meeting  the  rcqulrc- 
Df'Dts  of  the  entry  descriptor  are  eliminated,  the  logic 
employed  is  "and/or”  logic.  For  example,  in  the  case  of 
an  entry  descriptor  like  Ao/C3/F14/H1,  etc.,  the  system 
takes  up  each  of  the  ileocrlptor  el<?ment8  in  turn.  For 
example,  it  might  start  with  A2.  Each  of  the  studies  In 
the  data  bank  (or  rather  its  descriptors)  would  be  ex¬ 
amined.  All  studies  not  hiwing  A2  in  its  descriptors 
would  be  eliminated.  All  the  remaining  studies  (selec¬ 
ted  because  they  included  A2)  wauld  next  be  examined  In 
terms  of  the  element  C3.  All  studies  not  having  C3 
Would  he  eliminated,  leaving  only  studies  described  by 
A2/C3*  These  remaining  A2yc-.  studies  would  next  be  ex¬ 
amined  In  terms  of  Fl4,  and  ail  studios  retrieved  by 
porting  on  A2/C3  but  not  also  having  Fl4  would  be  rejec¬ 
ted.  This  Is  the  eceence  of  the  "ending”  process. 

"Or"  logic  is  represented  by  the  subcetegories  with¬ 
in  each  major  category,  e.g.,  /id, 2,4/.  When  this  ele- 
tient  descriptor  is  applied  to  the  HPR  data  bank  It  iDoans 
that  studies  possessing  either  Kl  or  K2  or  K4  are  accep¬ 
table. 

By  this  progressive  corting/matchlng  process  the 
precise  answer  to  the  question  asked  can  be  secured, 


ulways  assuming  that  the  data  bank  contains  tho  reeulta 
ol‘  otudlea  corresponding  to  the  entry  descriptors.  It 
la  of  course  conceivable  that  the  combination  of  elo- 
nenis  arv'ctriuU  in  the  entry  desarlptor  has  no  precise 
coiini»Tvait  in  the  data  bank.  In  fact,  with  a  ei&all 
prcLlmLnory  data  bank  such  as  the  one  developed  for  tbit 
study,  thin  is  often  the  case.  Although  one  or  more 
otudisc  ccrrccpondir.f;  to  in  t.h»*  tA.xf»nft«y 

obvlouoly  (^xLstn  in  tho  data  bonk,  the  n’uaber  of  eXemeot 
comiitnetloi,o,al  I  hough  not  infinite,  b  very  Xarge,  and  the 
prcclee  oumblniiUon  clc'drai  may  not  exlot.  Under  these  clr- 
cumsiax.’cu  the  ustTof  the  systeni  cos  back  off  from  his entiy  de¬ 
scriptor  and  acc*!ptalnap  predae  answer ;  he  expands  tbs sociXi 
<<‘hls  quufiLL>n  by  adding  "or"  elements. 

RESULTS 

'flu*  unufulneun  of  the  HPR  ystom  U0  tested  ty  exercis¬ 
ing  U»L-  oyulm  b->  dcbiitQkie  th:  klndn  of  onav'.'rs  it  could  sup¬ 
ply  to  roproacTitativc  oyatem  devoXopment  questions.  Only 
the  capubiltcy  to  retrieve  relevant  data  is  being  test¬ 
ed  here.  Tho  validity  of  the  data  retrieved,  was  not 
tested. 

The  method  uoed  to  exercise  the  BPR  system  was: 

(1)  Develop  a  muaber  oi  questions  based  on  problems 
arising  out  of  actual  system  development  projects,  the 
Titan  II  Propellant  Transfer  and  Pressurization  Astern 
(ftps)  and  the  Bunkor-Rejno  BH-90  Visual  Analysis  Consolo. 

(2)  Code  tho  questions  developed  In  (1)  using  the 
taxonomic  categories  of  Table  6. 

(3)  Manually  sort  through  the  code  descriptors  of 
the  l40  studies  comprising  the  preliminary  HPR  data  bank 
until  appropriate  matches  are  made. 

(4)  Examine  the  data  output  by  tne  studies  retrieved 
in  (3)  to  determine  their  relevancy  to  the  question  ask¬ 
ed  in  (1). 

The  efflolency  measure  utilized  is  what  Information- 
retrieval  specialists  term  a  "precision  ratio**  (Uincaa- 
ter,  1968).  This  is  defined  as  100  x  ^  wtiere  R  is  the 
number  of  relevant  documents  retrieved  In  a  search,  and 
L  is  the  total  number  of  docuflients  retrieved  In  that 
search*  In  the  case  of  KPR,  if  10  studies  are  retrieved 
in  a  given  search,  of  which  8  are  relevant  to  the  in¬ 
quiry,  the  precision  ratio  is  80^. 

Relevancy  is,  unfortunately,  a  highly  subjective  mea¬ 
sure.  For  this  reason  two  other  staff  personnel  besides 
the  one  conducting  the  HPR  search  Judged  the  relevancy 
of  the  retrieved  studies.  Conflicts  in  Judgment  were 
compromised  by  assigning  "partial"  relevancy  scores. 

Moreover,  relevancy  la  not  a  binary  attribute.  Rare¬ 
ly  doeo  one  retrieve  studies  which  unequivocally  aoswer 
the  question  asked.  In  most  cases  the  studies  retrieved 
provide  only  partial  answers  to  the  problem.  The  fol¬ 
lowing  criterion  'as  therefore  adopted:  a  Study  is  rele¬ 
vant  If  it  contains  data  appropriate  to  the  general  sub¬ 
ject  of  the  quGBtion  asked,  even  though  the  data  do  not 
conq^lctcly  answer  the  question. 

The  tests  wore  performed  to  answer  certain  methodolo¬ 
gical  questions  which  derive  from  the  fundamental  issues 
to  be  resolved  with  HPR: 

(1)  Can  HPR  retrieve  data  appropriate  to  the  inqui¬ 
ries  ;nade  of  it? 

(2)  What  Is  the  process  by  means  of  which  appro¬ 
priate  data  sources  ore  retrlevedt 

(3)  Can  data  from  the  general  bebavioxal  literature 
be  Integrated  with  man-tnachlne-speciflc  data? 

(4)  What,  degree  of  precision  is  required  in  foraula- 
tlng  a  question  to  be  asked  of  EPRT 

(?)  What  is  the  minimum  amount  of  Inforoatlon  with 
which  one  must  enter  the  data  system  to  retrieve  appro¬ 
priate  data? 

Ten  (10)  test  questions  were  developed  baaed  on  the 
FTPS  and  BR-90  syatema.  These  dealt  with  such  topics  as 

(a)  the  loss  of  performance  efficiency  one  might  ex¬ 
pect  over  a  6-8  hour  shift; 

(b)  how  rapidly  an  operator  can  respond  to  aa  aaav-- 
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gency  Dlluutlon; 

(c)  vhat  kind  of  owitch/lndlcai;or  comblr.atlun  vlll 
most  correctly  and  quickly  operated; 


vtuiv  xn  uic  UIUA1.IUUJU 

flhould  be  presented  on  a  smll  CRT  at  any  one  time* 

Tho  follovdng  tcct  proo^jduro  is  typical  of  that  used 
In  each  tost  question*  The  queutlohj  what  ii:  the  minl- 
maJ  Blze  of  Bymbol  required  to  monitor  a  “IV  presenta¬ 
tion,  vus  coded  Al, 5/H1/H14>  J  5/P7* 10.  Thlo  was  obvious¬ 
ly  Q  perceptual  function,  hence  category  A  was  appro¬ 
priate.  Monitoring  may  Involve  either  detection  of  the 
cynbol  and/or  recognition  of  Its  meaning.  Hence  A1|5  to 
cover  both  poasibllltiee*  It  is  a  TV  prssentatlon; 
henco  HI.  Symbol  size  is  Involved,  hence  categorioa  Kl4 
or  M.15  would  be  appropriate  (since  we  do  not  know  how 
the  symbol  size  Is  to  be  described). 

The  retrieval  process  Is  described  by  the  table*  This 
table  has  two  parts:  the  categories  with  which  one  en- 
and  the  studios  retrieved  as  a  re- 


ters  the  HPR  system, 
null  of  the  search. 

Bntry  Categories 

(1)  a1,5 


(2)  HI . >A1,5^ 

(3)  MlU,i5— ->Hi3 


Indtx  No«.  of 
Studies  Retrieved 
1,  5, 11, 12,13,16,  IT.IH,  20,  22,  24, 
26,  27,  26, 29,  31, 33,  35,  36,  37,  30, 
43,44 
l6,  31 
16 


Study  16  has  a  descriptor  of  A5/S**/f43/Hl/l7/J3,6)10/ 
K4/H3,  14/P3.  Study  l6  la  In  fact  the  study  we  want  be¬ 
cause  It  deals  with  the  Identification  of  symbols  on  TV 
as  '  function  of  raster  scan  lines  and  iiasge  size. 

The  precision  ratios  produced  by  each  of  the  10  test 
seaxchea  are  listed  below: 


Question 

1 

2 

3 

4 

5 

6 
7 
6 
9 

10 


Freoislon  Ratio 

- W - 

66« 

75# 

T5# 

56# 

6ji 

50# 

100# 

100# 


The  mean  precision  ratio  is  73>9#' 


COMCIJUSIOMS 

The  conclusions  drawn  from  tho  results  of  the  test 
situations  are: 

(1)  It  is  possible  to  expand  the  HPR  data  base  pro¬ 
vided  one  la  not  restricted  to  the  traditional  probabi- 
XlstlC)  reliability  oriented  metric.  The  behavioral 
literature  contains  considerable  data  that  are  useful 
for  BPR's  design  capability.  However,  because  of  the 
variety  of  neaeures  en^Ioyed  in  the  experimental  stud¬ 
ies,  much  of  these  data  cannot  be  transformed  into  pro¬ 
babilities  of  accon^llshlng  tasks  or  partitioned  into 
probabilities  for  Individual  equipment  characteristics • 

(2)  Integration  of  data  from  the  behavioral  litera¬ 
ture  is  possible,  but  not  on  the  basis  of  statistical 
combination.  The  problem  with  the  statistical  averaging 
of  data  from  C  Afferent  data  sources  Is  that  it  may  in¬ 
volve  cooiblnl^ig  apples  and  oranges*  Data  on  accuracy  In 
reading  alphanvjaerlc  syodjols  on  a  CRT  gathered  in  good 
lighting  conditions  and  in  dim  lighting  vlll  produce 
distinct  dlf.’i'erences  in  accuracy.  It  Is  of  course  pos¬ 
sible  to  ignore  the  differences  in  lighting  conditions 
|uid  to  av<;7  ^e  the  two  Sets  of  results,  but  the  answer 

This  -neaiis  that  we  apply  category  HI  to  all  studies 
retrieved  after  searching  with  descriptor  Al, 5* 

3«Thi8  means  tViat  wc  apply  descriptor  Ml4, 15  to  ell 
studies  retrieved  efter  searching  with  descilptor  HI. 


rocolvi.’d  inoy  well  bo  misleading  unlosfl  the  user  of  the 
dat.%.  indleiitt'S  that  he  does  not  :(u:c  about,  lighting  con- 
aitlona. 

Annthar  vav  of  viewing  integration  of  data  Is  in  tarm 
of  the  applioation  of  a  eoonon  conceptual  framework  to 
both  cunoraJ  behavioral  data  and  man-macblne-Bpcclf ic 
data.  In  the  context  of  this  study  the  HPR  taxonomy  is 
Liiiit.  i-uinmon  conceptual  fraaewrk.  Xt  Is  possible  to  as¬ 
sign  rclationahlpo  in  this  conceptual  structure  to  a 
vldfi  variety  of  otudles  of  dlfforont  types,  thus  laite- 
gratlng  them. 

(3)  Our  definition  of  integration  en^haslzes  making 
data  available  to  the  user.  From  that  standpoint  the 
HPR  cystem  Is  not  only  a  <lata  iategrutlon  system  but 
also  un  Inforroat.lon-rctricvai  system.  From  the  results 
of  the  test  cearches  HPR  would  seem  to  be  reasonably 
effective  in  supplying  answers  to  system  develoi»f»nt 
questions . 

(4)  The  system  methodology  permits  an  elmoet  infi¬ 
nite  numbor  of  questions  to  be  asked,  limited  cn  ly  by 
tho  taxonomic  atructuro  lo  far  developed.  Die  ayatom 
will  nnawor  both  general  and  apeclfic  riuestlona.  ttia 
Hole  preclaely  the  luoBtlon  Is  phraaed,  however,  the 
store  precise  the  onawer  retrieved,  provided  always  that 
the  data  bank  contains  relevant  data. 

(5)  It  is  possible  to  search  the  HPR  oyaton  with 
only  one  or  two  descriptors.  Certain  descriptors,  e.g., 
M,N,0  are  morn  discriminating  than  others,  eg,,  J  and  K. 
However,  all  tho  taxonomic  categories  are  necessary  be¬ 
cause  It  lo  cor.cnlvnble  that  a  question  Involvln  these 
categories  will  bo  asked.  HPR  can  be  entered 

with  alternative  descriptor^  but  in  general  the  same 
studios  will  be  retrieved  regardless  of  search  strate®. 

(6)  The  volume  of  studiee  and  the  numbor  of  descrip¬ 
tor  oleraonts  is  such  that  any  practical  use  of  HPR  re¬ 
quires  computer  assistance.  However,  since  the  system 
can  ho  searched  with  alternative  strategies,  soaw:  of 
which  arc  more  efficient  than  others,  any  computer-aided 
HPH  must  retain  a  manual  mode  and  provisions  for  on-line 
dialogue  betvenn  the  computer  and  the  user.  Since  the 
Judgment  of  relevancy  Is  determined  by  the  user,  the 
user  must  have  tho  capability  of  enlarging  or  reducing 
hla  entry  descriptors  at  any  time  and  selecting  the  data 
be  wishes  to  Inspect. 

(7)  The  proouas  of  encoding  the  user's  question  re¬ 
quires  Judgment  and  practice  but  is  not  Inordinately 
difficult.  With  practice  the  coding  of  data  to  be  In¬ 
cluded  In  the  HPR  data  bank  becomes  relatively  almple 
for  the  great  majority  of  studies  abstracted. 

We  do  not  pretend  tlat  HPR  la  at  the  present  time  more 
than  a  concept  which  not  only  seems  feasible  but  also 
has  considerable  potential  not  only  for  the  user  who  la 
a  system  developer  but  also  for  researchers.  Because  It 
organizes  the  mass  of  behavioral  literature  which  la 
highly  scattered  and  diverse,  it  can  permit  the  resear¬ 
cher  to  determine  exactly  what  Information  Is  or  Is  not 
available  and  thus  may  render  the  research  process  more 
efficient. 

Manifestly  considerably  more  work  la  required  If  any¬ 
thing  practical  Is  to  be  done  with  HPR.  The  taxonoey 
requires  refinement,  further  testing  with  a  considerably 
enlarged  data  base,  and  possibly  reorganization  to  oaks 
It  more  efficient.  The  problems  involved  in  computeri¬ 
zation  of  the  system  need  to  be  explored. 

Whether  or  not  HPH  development  Is  continued,  we  can 
Bay  with  some  confidence  that  the  HPR  data  base  can  he 
expanded  and  that  It  can  be  made  substantially  more  use¬ 
ful  for  system  developers  than  It  has  been  so  far. 
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TABLE  1. 

DATA  BANK  KOFMAT  I 

Stlfflulua  Activity 

Probability 

of  Correct  Response 

1. 

Turn  rotary  uoloctor  switch  and 
oho»3rvt!  CRT  r.lgnai  quality 

.9972 

a. 

Obutirvo  eevoral  dials  qualitatively 
for  correct  readout 

•  9973 

is 

Obo«;rv«’  rmlar  ucope  and  mark  tarfjet 
porLtlon  with  ^rcaae  pencil. 

.9989 

4. 

Track  rupldiy  moving  radur  target 
with  2  unldlmcnuional  controla. 

.9709 

TABLE  2. 


Reliability 

■  9963 
.9967 
.9963 


.9981 

.9975 

•9960 


DATA  BAMK  FORMAT  II 
JOYSTICK 

Parameter 

1.  Stick  length 

a.  6-9" 

b.  12-18" 

e.  21.?.r' 


2.  Extent  of  stick  movement 

a.  5-20  degreea 

b.  30-40  degrees 

c.  4o-6o  degrees 


TABLE  3.  DATA  BANK  FORMAT  III 


Equlpittent  ^^7>e;  Vf 
Characteristics 

Symbol  Slae  (mins) 

Wo. 

Percent  Correct  Response 

Scan  Lines  per  Symbol  Height 

1.  No.  of  raster  scan  lines 

4.6 

.  6.3 

7.8  13.5 

jxjr  aymbol  height 

U.U 

66 

76 

70  So 

2.  Symbol  eubtonoo  angle 

6.0 

73 

91 

91  95 

10. £ 

66 

87 

97  99 
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TABLK  J*.  DATA  BANK  POHMAT  IV 


1*^^^ I pm'-iit  Ty|ii':  Ivxrf/,'-  SoT'i'^n  Dluploy 
f?hurrtrit;rlal.I{-c 

1,  Vi-rLlfui  v::.  horizontal  fur- 
m/ii-t 

P.,  Kffnot.  of  coding  UlBplny. 

j.  KlTcM't  of  nnmbor  of  atlmu)!. 


Pcrfonnuhoo  RoJationr.hlpG 

66f>  moiM  time  iQ  opont  ecanning  vertical  fornat 
than  is  spent  on  horizontal  array. 

Mean  lu  locate  oodttd  update  lufuiuiatlui'i 

lo  approximately  651^  leas  than  for  uncoded 
updates . 

ResponBu  tiiac  increases  linearly  with  number 
of  Dtlnuluo  clem»^ntB  preoonted. 


TAB1J-:  DATA  BANK  FORMAT  V 


apilpmonl.  Tyin.'i  ClH*  Diupluyo 
OharacicrioticB 

1,  Probuhl] Ity  of  correctly  performing 
reading  nnd  updating  functions. 

ft.  With  alphanumeric  nymbola. 

1.  With  geometric’  oymbolo. 

4.  As  a  function  of  roBolutlon: 

6  neon  lines 
8  scan  lines 
10  Bean  lines 
IB  Bcan  1 Ineo 


Performance  Relatlonahlpr. 

.97U3« 


.9089* 


.9654* 


.7543* 

.06Ut* 

.9044* 

.9736* 


5.  Th(!  uffoct  of  donolty  aid  dlspliijr  uncooeo  •  + 

c'xpoaiirn  t.lmn  on  accuracy.  COLOdCOOto*© 


6.  Improvement  in  observer  performance 
when  dloplays  are  coded. 


Origi  rial 
Displays 

Code  Type 

Observer 

Function 

f  Accuracy 
Improvement 

^  Response 
Time  Improveoeat 

Aiphanurooricfl 

Color 

Locating 

U4 

Aiphonumcrlcn 

Color 

Counting 

86 

72 

Aiphnnumi'ricB 

Size 

Update 

50 

65 

Map 

Coneplculty 

Information 

97 

(borders ) 

Assimilation/ 

and 

Extraction 

57 

*NOTI!: 


Thei'.e  probabilities  are  purely  hypothetical. 
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TABLE  6, 


THE  HPR  TAXOHOMT^ 


A.  r'-rfi  pl  uhI ( cf'axinlnt?  dloplayo,  phyolcal  or 
r.nt'irtil 

I.  'I'i'  or  ViTKy  th.-  ftppfuniri'-o  of  stimuli. 

To  riot.c-  tif  t.h'!  nujvnmont  of  ntlmuli. 

To  n  .-hunf^:  la  stimuli* 

u  caAiiK  '  In  ntlmulus  oharapieriotice* 

%  To  ItlonLlt’y/catofrorl-.'.u/rirc'ognlT'.e  otlnull  In 
termi;  of  tomwn  dutn. 

(t,  'l‘o  f’()rnp(u*c  ijttmiiluc  ohariu'torlatioo. 

/.  To  Idfutlfy  iitlmull  that  (ieviaU*  from  otondardc 
(.r  nth'T  oLlmuiL. 

II.  To  lof-at.i-  thi*  posit  ion  of  iit.lmuil  or  objoots  In 
UTino  of  i\  oi.ruidard. 

').  'I'o  nhant/.o  tho  rooitiou  of  ntliuull* 

To  (.’hft/ijat  blio  ('harnotoriot.ico  of  stimuli  by 
mot  or  a<’t  Inn. 

II.  To  >'ounl  or  culfulati*  at.imull. 

l::.  To  lnlrod’r'«;/input  now  ntlmull  by  motor  action. 

M.  To  iluJr-to  or  romovo  ntlmull  (revsreo  of  (12)). 

!•»,  Ti'  read  wtuiro  reudlnn  Ib  the  sole  function  In- 

vol  v«*ii , 

All*  Auditory  t*«’rri'ptlon 

I.  To  doti’ct  or  vurilV  tho  nppoorance  of  ptlmull. 
r.  To  dut.i:ct  the  movement  of  stimuli. 

t-l(.  D-'I.'t-d 

!>*  T«»  ldL’ntiry/cfit,<y.orl/n/riTOBnl:te  atLmull  In 

I'TiriM  of’  known  datu. 

To  (’ompnro  tho  charocbctrlatloa  of  auditory  otim- 
u)  1  • 

?,  Idnntify  stimuli  doviutlng  from  stundardB  or 
other  otimull. 

6.  T<j  dotoiM  a  uhnnfic  In  the  stlniUus* 

9.  Dolc^tud. 

10,  To  nhnnRc  tho  charaotorljtl'.io  of  auditory 
utlmuH  by  motor  action. 

H.  To  ooiuit  or  oalculatt'  stlmtili. 

T.  Tupt.jle  Por<M;pblon 

1.  To  dotfjoi.  the  ocourrerii’o  of  a  tactile  oenso- 
t.lon^ 

B.  DLorretn  Motor  BehavlorG 

1.  To  nrtlvuto  eontrulo  to  pooltlons  without  dis¬ 
played  Information. 

To  activate  controls  to  pt'sitlons  in  accordajico 
with  or  an  a  result  of  dieplayed  Information. 
iJt'icU’d 

S«  To  connoct  or  dicconnoet  objects  cither  directly 
or  with  tools. 

(■>,  To  carry  objf'cts, 

f.  To  op('n/'*loao  door  or  rnclosure. 

M,  Ti>  mark  position  of  objects. 

9.  Deleted. 

10.  To  aim  at  an  '  eject. 

II .  To  1  Lft  objoc'.. 

12.  To  drop  object. 

C.  Conttriuoua  Motor  Behaviors 

1.  To  adjtint  poslt.lon  of  objects  without  reference 
to  dlsploycul  Inforruitlon, 


Thin  1:5  nn  ahbri -v lat<;d  version  of  the  orlRlnal  taaono- 
niy.  D*  t/ilied  -lof Inltlon.s  fuid  exiimpleri  will  be  foxind  In 
Ml-'  final  report  of  this  study  referred  to  earlier. 


2.  To  adjust  position  of  objects  In  accordance  with 
or  as  a  ruault.  of  dlsplay^tl  Information. 

1*  To  adjust  position  of  controls  to  change  tho 
position  of  moving  stimulus. 

U.  To  record  Infomstion  manually. 

5*  To  Input  data  by  activating  controls. 

6.  To  input  data  manually. 

7.  To  walk  from  one  point  to  another. 

8.  To  cwlid  from  one  point  to  another. 

9-  To  run  from  one  point  to  another. 

10.  To  throw  an  object. 

11.  To  exert  hand  grip. 

12.  To  remove  objects  from  or  install  them  In  de¬ 
signated  x>^oitlons. 

13.  To  rile  objects. 

D.  cognitive  Behaviors 

1.  To  perform  quantitative  computations. 

2.  To  compare  calculated  values. 

3.  To  decide  between  two  or  more  hypotheses. 

To  unalyzo  Inforoatljn. 

5.  To  hypothesize  causal  relationships. 

6.  To  verify  that  an  hypothesis  is  correct  or  In¬ 
correct. 

7*  To  code/decode  stimuli* 

0.  To  predict  the  occurrence  of  an  event. 

9*  To  recall/romember  otlraull/events  (short  tens, 
long  term) . 

10«  To  estimate  the  occurrence  or  characteristics 
of  phenomena. 

11.  To  note  a  change  in  displayed  Information. 

E.  Cowaaunlcations 

1«  To  request  instructlona/informatlon  using  4^ 
device. 

2«  To  request  Inatructlons/lnformation  fact  to 
face. 

3*  To  eomnunicatc  Inatructlons/lnformation  over 
device • 

k»  To  coaBunlcatc  inatructlons/lnformation  face  to 
face. 

5.  To  listen  to  Information  supplied  by  device# 

6.  To  listen  to  information  supplied  face  to  face. 

F.  Visual  Stimuli 

0.  Stioulus  not  specified. 

1.  Alphabetic  characters;  static. 

2*  Alphabetic  characters;  ntovlng. 

3*  Nun^ric  characters;  static* 

U.  lYumerlc  groups;  static. 

5*  Numeric  groups;  moving. 

6.  Alphabetic  words;  static. 

7.  Alphabetic  words;  moving. 

6.  Numeric  characters;  moving. 

9*  Alphanumeric  groups;  static. 

10.  Alphanumeric  groups;  moving. 

XI*  Unstx^ictured;  static. 

12.  unstructured;  moving. 

13.  Coded  (geometric  symbol);  static. 

Ih.  Coded  (geometric  symbol),  moving. 

19.  Coded;  color. 

l6.  Natural  object. 

17*  Photograph  of  natural  object. 

1.8*  Written  statements. 

19.  Environmental  (sly,  land,  water). 

20.  Deleted. 

21.  Pointer  deflections. 
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TAULli  6.  TIUi  I£PB  TAXONOMf  -  (Continued) 


?/,],  (Jrld  map. 

?.U  OoollloRrttph  truoc. 

J'h.  Terrain  map. 

213.  paper  chart  trtif'c. 

26 .  Graph . 

Q.  Auditory  Stimuli 

1.  Toneo  vnryln^^  In  frequency. 

2.  Toneo  varying  In  loutineoo. 
2A.  T«iru'  fu^quf'nci'O . 

213.  Interruption  of  tone. 


i. 

Compl(;x  noundci  varying  In 

fr<.*quency 

4. 

Complex  Qoundo  varying  ir> 

.loudiioso . 

5. 

Worda  a 

6. 

Numbero, 

7. 

Letter  uoqunnccQ, 

II*  Dlnplay  Equipment 

I.  CRT  (W  typo). 

CRT,  PPI  type,  standard. 

1,  CRT,  PPI  typ.',  non-otnndard. 

*1.  Curd,  drawing  or  other  paper  presentation. 

5.  Projoctrcl  display,  otatlc. 

5A.  Projorted  display,  dynamic* 

6.  Large  ncreen  dloplay* 

7.  Film. 

8.  Sound  recording. 

9.  Natural  ob,loct. 

9A.  PhyalcaJ  object  not  rnecnibllng  natural 
ohjoctu* 

10*  Indicator,  steady  ctato. 

U.  Indicator,  blinking. 

12,  DoJctcd, 

1  i,  Vlnual  track,  dynamic. 

iH.  Still  photograph. 

ID.  Internal  component. 

.16.  Display  panel,  non-cockpit. 

17.  Cockpit  Inatrumcnto. 

IB.  Legend  light* 

19*  Scale  indicator^  motor* 

20.  Scale  Indicator,  circular  or  curved. 

21.  Scale  Indicator,  horizontal  straight* 

22.  Scale  indicator,  vortical  straight. 

23.  Scale  Indicator,  fixed  pointer,  moving  scale. 

24.  Counter,  direct  reading. 

25.  Printer. 

26.  Plot  board* 

27.  Matrix  board. 

2.8.  Person  to  person  speech. 

29,  LoudopoaKor. 

30,  Dell,  buzzer  or  horn. 

JJ .  Oscillograph. 

32.  Switch  Betting. 

33.  Tachiatoscopo. 

34.  Paper  tape  recorder. 

35*  Moving  bolt  containing  stimuli. 

36.  IDorphones. 

37.  Electro-pulse  otlmulator, 

1 .  Control  Equipment 

1.  Dincreto  control,  single,  c.g*,  switch* 

2.  Discrete  control,  multiple,  e.g^  keyboard. 

2A«  Chord  koyhofArd. 

3.  ContiriutMiB  rotary  contrcjl,  single,  o.g.,  dlul, 
knob. 

3A.  Continuous  rotary  control,  multiple,  eg., 
"ganged"  knobs. 

4.  Thumbwheel. 

5.  Continuous  1  Inear  control,  single,  e«g.,  lever. 


Joystick. 

5A.  Sldearra  controller, 
controller. 

5C.  Displacement  control. 

5D.  Preaaurc  control. 

6.  Track  ball. 

I.  Verbal  reoponue. 

8.  Written  response. 

9.  Control  panel . 

10.  Walking. 

11.  Running. 

12.  Swlmnlng. 

13.  Microphone. 
lU.  Steering  wheel. 

15  •  llirDvlng . 

16.  Alrcra/t  .laulator. 

17.  I^amoisetor. 

18.  Nuto/bolts. 

19.  Sextant. 

20.  Punch  device. 

21.  Pencil. 

22.  Typewriter. 

23.  Llghtpen. 

24.  glectro-mechanlcl  manipulator. 

25.  Push-pull  device. 

26.  D-rlng. 

27.  Bandtoola. 

28.  Moving  table. 

J.  Sub.lect  Variables 

1.  Unknown. 

2.  Civilian  student  (both  men  and  women). 

3.  Civilian  nsn-etudent  (also  men  only). 

4.  Mllltuy  personnel,  undifferentiated. 
4A.  Military  student. 

4B.  Military  reservist. 

5.  previous  task  experience,  unspecified. 
5A.  Movlce. 

$B.  Somewhat  experienced. 

9C.  Highly  experienced, 

6<  Ho  previous  task  experience. 

7.  Diver. 

8.  Under  30. 

9.  Over  30. 

10.  Pilot. 

11.  Seaman. 

12.  Mtlntenaoce 

13.  Clerical. 

14.  Technical. 

19.  Shop. 

16.  Inspector. 

17.  Women. 

18.  Police. 

K.  Response  Meaeure 

1.  Error,  number  of. 

2.  Response  duration. 

3.  Reaction  time. 

4.  Accuracy. 

5.  Trlala  to  criterion. 

6.  Response  variability. 

7.  Time  to  criterion  or  time  to  learn. 

8.  Number  of  subjects  reaching  criterion. 

9.  Distance  travelled. 

10.  Trials  to  learn. 

11.  Target  acquisition  time. 

12.  Omissions,  number  of. 

13.  Errors  and  omissions  combined. 

14.  Velocity. 

15.  locb/ounces,  torque. 
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TABLE  6.  TOE  HPR  TAXONOMT  -  (Continued) 


iTi.  Force  ( Iba. ) . 

1  /.  Number/ por<*f?nt  tuiao  rcjK'rt.a  (detection). 
I'l.  'U'«p,i>*eb/cn:cumlo  *->r  aii-. 

1'^.  1 1  UimlnatLon  menaure. 

'■.0.  MaAnltuclo  eatlnwitlon. 

?.]*  Hncognltlon  thrcahold. 

I’.y.,  Time  on/ot'f  turEot. 

Roaponne  probability. 

*  Number/percon  t.  do  tec  k  Iona. 

I'S.  Porcepi./rank  pr*  forpn«M« 

I'/i.  Confldrtnre  In  ronponne. 

>'Y.  Percorit.  nrrorn. 

Percent.  iicc\irt\cy. 

Trlalfl  In  error. 

if),  litroktiu  por  Rroorul  or  operation. 

U.  Porc«’nt.  omlsolonB. 

RnnEe  at.  which  oiimull  ore  recognized. 

U.  Point  (jC  oubJf'(:tl v»*  equality. 

Body  rilmenfllona. 

Corrolutlun  valUi>o. 

I,,  b^ivi  ronmental  Factcira 

1.  Tomporaturu. 

Nolnc. 

1.  Llp.htlnf*. 

Vibration. 

5.  Af’celuratJon. 
fu  Uridorwutor. 

(,  Soiitid  In  tonally. 

6*  Wind  speed* 

9.  Air  speed. 
lU.  Night. 

11.  bay. 

M.  Significant  Sl.lmulua  Charactoriatlcg 

1.  Otlmull  grouped, 

2.  Stimuli  ungrouped, 
la  Stimulus  resolution* 

U.  Stimulus  brightness. 

5*  Stimulus  Int'malty. 

6.  Stimulus  durationt  inuDentary* 

■f.  Stimulus  duroblou>  Intermediate* 

^1.  Stimulus  duration,  prolonged. 

9.  Stimulus  almliarlty,  physical. 

10.  Stimulus  simtlnrltyi  analog. 

11.  Number  of  etlmulun. 

IIA.  Frequency  of  atlraulus  presentation* 
12*  Stimulus  location* 

I  1.  Stimulus  viewing  nngU?. 

J.l*.  Stimulus  olzo,  angle  oubtunded. 

15*  Litlmulus  size,  physical  dimensions. 

l6.  Spued  of  etlmuluB  movement, 
ly.  SfMl(;  graduations. 

1^1.  Monaural  auditory  stimuli. 

19.  Binaural  auditory  otlmuil. 
f’O.  Stimulus  mode  of  presentation. 

'11  .  Preadptatlon. 

fjt.lmul'iB  color/color  contrast. 

:m.  Display  format  vertical. 

Display  format  hor l/.ontal. 

Display  format  variable. 
j:6.  Display  Hpaclng/locutlon. 

'<'■(•  Amount  of  Information. 

Amount  Information  change. 

"f'  U  nt  lmulur.  brt/';htnosr.  contrant, 
u  I .  K  Lg.  .re/ground  re  lu  1 1  on  nhlp  • 

Uoli’tc-l. 

V'‘.>  Dtlmul-up  static,  unmoving. 

M.  Stimulus  moving, 

V».  lArgo/group  display, 

15.  Smaii/indlvlduQl  display. 


36.  Stimulus  coding. 

37*  Type  of  verbal  material* 

36,  casssm  field  of  view. 

3dA*  Shades  of  gray. 

39 >  Slant  range  to  target. 

Scale  orientation* 

4l.  Dlspleiy  advanced  or  deli^ed. 

42*  Nunber  of  ntlmuius  channelt* 

43*  Number  of  levels  of  information  per  channel. 
44*  Rate  of  display  change* 

45.  Number  of  stimuli  to  be  detected* 

46*  StlmuluB  flash  rate, 

47*  Type  font. 

46*  Stimulus  aperture  size. 

49*  Stimulus  distance  travelled. 

50*  Stimulus  presentation  speed. 

51.  Stimulus  clustering. 

52.  Intersensory  stimulus  combinations. 

53*  Distance  aeparating  stimuli. 


N.  Significant  Control  Characteristics 
X.  Number  of  controls. 

2.  Location  of  controls  In  front  of  operator. 

3*  Location  of  controls  to  side  of  operator. 

4.  Control  operated  with  ungloved  hands. 

5.  Controls  operated  with  gloved  hands, 

6.  Arrangement  of  controls  varied. 

7.  Control  size. 

6*  Spacing  between  controls* 

9*  Number  of  parts  in  internal  cooqwnent* 

10.  Control-dlsplsy  relationship  compatible. 

11.  Control-display  relationship  lncoiq)atlble. 

12.  TyvQ  of  vehicle  being  controlled. 

Vj*  Control  panel  size. 

14.  Control  panel  narXlngs. 

15.  Manipulator  characteristics. 

16*  Control  friction. 

17 .  Control  inertia. 

16.  Control  position  relative  to  body* 

19.  Direction  of  control  movement. 

20.  Control  force. 

O.  Performance  Task  gactors 

1.  performance  over  successive  trials. 

2.  Performance  over  successive  hours. 

3.  Performance  over  auccesslve  days. 

4*  Performance  over  successive  shifts* 

Performance  in  terms  of  time  of  day. 

6.  feedback  presented. 

T.  Feedback  not  presented. 

8.  Type  of  feedback. 

9.  Amount  of  feedback. 

10.  Feedback  delay  amount. 

11.  Stimulus  viewing  distance  close. 

12*  Stimulus  viewing  distance  remote* 

13»  Performance  within  moving  vehlcle/alimilator. 

14*  Deleted. 

15,  Distance  travelled  by  operator. 
l6*  Direction  of  movement  by  operator. 

17*  Defect  rate  (inapectlonV 
ITA.  Defect  type. 

18.  Number  of  responses  controlled  by  Instructions. 
19*  Speed  of  responses  controlled  by  Instructions 

20.  Tracking  in  1  dlicenalon. 

21.  Tracking  in  2  dimensiona* 

21A.  Tracking  in  3  dimensions* 

22.  Pursuit  tracking. 

22A.  Tracking  control  break  point. 

22B.  Tracking  control  dead  zone* 

22C.  Target  step  function. 


14 


TAJILK  6.  THE  HPR  TAXONOMf  -  (ContlnuBd) 


iiji*  rfimp  i  njifi.ujti. 

li  -i .  Componnn  toj-y  tratik  Ln/j; . 

Tarfi<‘i  nl.#!p  funcllon. 

Tam>t  i'uirtp  I'uncLlon. 

?.h.  Dniotc'd. 

25.  PorformFinre  Incontlvo  provided. 

26.  Alrnraff.  emerpioncy  taake. 

?.{.  Anrodynamic  flight  nqual.lono. 

2f)<  Miiuoogn  lo/id. 

29.  Morm>n'.a  typo. 

^0.  Job  alUu. 

}] »  Computor-Qidod  Inotruf.'t  ion. 

32.  Subject  himdcdncoD. 

33.  Tracking  dynamlnn. 

3*1.  Tuck  cuolng. 

Sneondury  tank. 

’/>.  T/irfV'l.  Import/uicn  varied. 

U*  Mining  data. 

.  .Tl.iidy  Subject.  Matter 

.1 .  TranBPor  of  training. 

2.  Tralning/practlco. 
j.  'I'hronboid  dotorirLinatlun. 

4.  Codo  tronQltttlon. 

'j*  Driving  performance?. 

6.  Tracking. 

Y*  Controlo/dlaploya. 

f'.  Fhyolcul  capability,  o.g.,  anthropometry. 

9.  Plying. 

10.  Honltorlng/dotcotlori. 

11*  h4otor  oHpnhillty* 

J2*  MonLol  capability. 

1  U  Target  identi flcatton. 

14.  Inspoction. 

.15*  Information  tranflmlealon. 
i6.  Command/cuntrol* 

17*  StlmuluM  legibility. 

Uh  Work  load. 

19.  Piling. 
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